vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #286
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.y8mOu0VE6r', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14(finished: start all VMs, in 75.99 seconds)15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab: waiting for unit setup-gitlab.service17gitlab # Filesystem UUID: c5a0b0b6-79c5-4d76-b586-5ce5495ae72218gitlab: waiting for the VM to finish booting19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xvdaqsfjgmb4472jdz6nm0rpgrjkdsac-nixos-system-gitlab-test/init regInfo=/nix/store/0vjhygcbsxclgksvx8zh4q6h9kgjdcz5-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/0vjhygcbsxclgksvx8zh4q6h9kgjdcz5-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f00000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f10000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f20000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000033] arm-pv: using stolen time PV108gitlab # [ 0.000424] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000618] Console: colour dummy device 80x25110gitlab # [ 0.000626] printk: legacy console [tty0] enabled111gitlab # [ 0.000812] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000819] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000933] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001086] landlock: Up and running.115gitlab # [ 0.001089] Yama: becoming mindful.116gitlab # [ 0.001586] LSM support for eBPF active117gitlab # [ 0.001815] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001932] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.003394] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.004134] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.004139] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.004299] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.005409] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.005508] EFI services will not be available.125gitlab # [ 0.005692] smp: Bringing up secondary CPUs ...126gitlab # [ 0.006383] Detected PIPT I-cache on CPU1127gitlab # [ 0.006514] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.006654] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006796] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.008014] Detected PIPT I-cache on CPU2131gitlab # [ 0.008125] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.008259] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.008390] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.009478] Detected PIPT I-cache on CPU3135gitlab # [ 0.009608] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.009748] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.009886] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.010475] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.010503] SMP: Total of 4 processors activated.140gitlab # [ 0.010505] CPU: All CPU(s) started at EL1141gitlab # [ 0.010515] CPU features: detected: Branch Target Identification142gitlab # [ 0.010519] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.010522] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.010526] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.010529] CPU features: detected: Common not Private translations146gitlab # [ 0.010532] CPU features: detected: CRC32 instructions147gitlab # [ 0.010534] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.010537] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.010540] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.010543] CPU features: detected: E0PD151gitlab # [ 0.010545] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.010548] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.010551] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.010554] CPU features: detected: Fine Grained Traps155gitlab # [ 0.010557] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.010561] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.010563] CPU features: detected: LSE atomic instructions158gitlab # [ 0.010566] CPU features: detected: Privileged Access Never159gitlab # [ 0.010568] CPU features: detected: PMUv3160gitlab # [ 0.010571] CPU features: detected: RAS Extension Support161gitlab # [ 0.010573] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.010576] CPU features: detected: Random Number Generator163gitlab # [ 0.010578] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.010580] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.010583] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.010587] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.010725] alternatives: applying system-wide alternatives168gitlab # [ 0.013979] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.014182] Memory: 5963808K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.015918] devtmpfs: initialized171gitlab # [ 0.020187] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.020257] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.020467] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.020471] 0 pages in range for non-PLT usage175gitlab # [ 0.020472] 508288 pages in range for PLT usage176gitlab # [ 0.020607] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.021527] DMI not present or invalid.178gitlab # [ 0.024918] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.027627] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.027938] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.030027] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.030058] audit: initializing netlink subsys (disabled)183gitlab # [ 0.030371] audit: type=2000 audit(0.028:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.030899] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.030902] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.030906] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.030909] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.030912] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.031051] cpuidle: using governor ladder190gitlab # [ 0.031103] cpuidle: using governor menu191gitlab # [ 0.031333] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.031571] ASID allocator initialised with 65536 entries193gitlab # [ 0.032755] Serial: AMBA PL011 UART driver194gitlab # [ 0.039200] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.039489] printk: console [ttyAMA0] enabled196gitlab # [ 0.048166] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.048186] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.048195] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.048203] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.048212] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.048220] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.048228] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.048236] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.055915] fbcon: Taking over console205gitlab # [ 0.055936] ACPI: Interpreter disabled.206gitlab # [ 0.057091] iommu: Default domain type: Translated207gitlab # [ 0.057114] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.069755] SCSI subsystem initialized209gitlab # [ 0.070307] usbcore: registered new interface driver usbfs210gitlab # [ 0.070335] usbcore: registered new interface driver hub211gitlab # [ 0.070365] usbcore: registered new device driver usb212gitlab # [ 0.070675] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.070679] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.070687] PTP clock support registered215gitlab # [ 0.070733] EDAC MC: Ver: 3.0.0216gitlab # [ 0.071357] scmi_core: SCMI protocol bus registered217gitlab # [ 0.072578] FPGA manager framework218gitlab # [ 0.073437] vgaarb: loaded219gitlab # [ 0.075111] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.097622] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.097700] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.098451] netfs: FS-Cache loaded223gitlab # [ 0.098640] pnp: PnP ACPI: disabled224gitlab # [ 0.106010] NET: Registered PF_INET protocol family225gitlab # [ 0.107250] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.141276] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.141346] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.141409] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.141827] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.142482] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.142628] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.142700] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.142826] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.143067] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.143089] NET: Registered PF_XDP protocol family236gitlab # [ 0.143176] PCI: CLS 0 bytes, default 64237gitlab # [ 0.143635] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.155817] kvm [1]: HYP mode not available239gitlab # [ 0.209753] Initialise system trusted keyrings240gitlab # [ 0.210182] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.211022] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.211273] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.250429] Key type asymmetric registered244gitlab # [ 0.250473] Asymmetric key parser 'x509' registered245gitlab # [ 0.250640] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.251008] io scheduler mq-deadline registered247gitlab # [ 0.251022] io scheduler kyber registered248gitlab # [ 0.259426] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.263398] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.264155] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.264192] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.264212] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.264223] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.264262] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.264303] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.264452] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.264465] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.264473] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.264480] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.264486] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.264665] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.265727] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.266160] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.266185] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.266243] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.266269] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.267444] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.267878] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.267902] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.267958] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.269021] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.269432] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.269456] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.269511] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.270556] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.270995] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.271019] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.271079] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.272144] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.272519] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.272541] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.272603] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.273559] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.273955] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.273979] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.274041] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.275058] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.275507] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.275532] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.275587] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.275614] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.276690] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.277103] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.277156] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.278158] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.278574] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.278627] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.279540] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.279958] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.280471] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.280991] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.281016] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.281075] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.282082] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.282503] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.282535] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.282598] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.283868] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.283881] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.283888] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.283976] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.284067] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.284165] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.284266] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.284352] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.284442] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.284535] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.284626] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.284719] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.284849] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.284945] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.284984] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.285020] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.285057] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.285104] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.285141] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.285179] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.285217] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.285254] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.285293] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.285330] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.285367] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.285400] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.285434] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.285468] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.285501] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.285536] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.285579] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.285621] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.285661] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.285702] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.285751] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.285761] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.285767] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.288295] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.327940] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.334316] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.341482] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.347612] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.353824] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.361100] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.367651] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.375079] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.381236] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.388226] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.395223] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.412669] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.417694] msm_serial: driver initialized359gitlab # [ 0.418126] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.418310] STM32 USART driver initialized361gitlab # [ 0.466461] loop: module loaded362gitlab # [ 0.467177] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.472928] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.478123] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.483931] virtio_blk virtio5: [vdb] 12283360 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.489958] megasas: 07.734.00.00-rc1367gitlab # [ 0.492577] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.498936] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.499039] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.504710] Using buffer write method371gitlab # [ 0.504820] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.509585] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.509634] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.515416] Using buffer write method375gitlab # [ 0.515468] Concatenating MTD devices:376gitlab # [ 0.515474] (0): "0.flash"377gitlab # [ 0.515482] (1): "0.flash"378gitlab # [ 0.515487] into device "0.flash"379gitlab # [ 0.729255] Freeing initrd memory: 27184K380gitlab # [ 0.749772] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.759745] thunder_xcv, ver 1.0382gitlab # [ 0.759900] thunder_bgx, ver 1.0383gitlab # [ 0.759984] nicpf, ver 1.0384gitlab # [ 0.761966] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.761981] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.762092] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.762107] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.762178] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.762188] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.762258] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.762270] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.762985] sky2: driver version 1.30393gitlab # [ 0.768772] usbcore: registered new interface driver usb-storage394gitlab # [ 0.769344] ehci-pci 0000:00:0a.0: EHCI Host Controller395gitlab # [ 0.769410] usbcore: registered new interface driver usbserial_generic396gitlab # [ 0.769434] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1397gitlab # [ 0.769536] usbserial: USB Serial support registered for generic398gitlab # [ 0.770388] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.771847] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.774965] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.775071] rtc-pl031 9010000.pl031: setting system clock to 2026-09-01T10:26:41 UTC (1788258401)402gitlab # [ 0.776347] i2c_dev: i2c /dev entries driver403gitlab # [ 0.779292] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.780112] hub 1-0:1.0: USB hub found405gitlab # [ 0.780151] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.786618] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.786638] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.787579] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.788702] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.793881] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.794914] usbcore: registered new interface driver usbhid412gitlab # [ 0.794927] usbhid: USB HID core driver413gitlab # [ 0.805010] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.810028] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.810553] NET: Registered PF_INET6 protocol family416gitlab # [ 0.812587] Segment Routing with IPv6417gitlab # [ 0.812621] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.812822] NET: Registered PF_PACKET protocol family419gitlab # [ 0.813121] 9pnet: Installing 9P2000 support420gitlab # [ 0.817420] Key type dns_resolver registered421gitlab # [ 0.836210] registered taskstats version 1422gitlab # [ 0.836678] Loading compiled-in X.509 certificates423gitlab # [ 0.855781] Demotion targets for Node 0: null424gitlab # [ 0.856015] Key type .fscrypt registered425gitlab # [ 0.856021] Key type fscrypt-provisioning registered426gitlab # [ 0.856172] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.856194] ima: Allocated hash algorithm: sha1428gitlab # [ 0.856225] ima: No architecture policies found429gitlab # [ 0.857647] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.885072] clk: Disabling unused clocks431gitlab # [ 0.885117] PM: genpd: Disabling unused power domains432gitlab # [ 0.890029] Freeing unused kernel memory: 4736K433gitlab # [ 0.890289] Run /init as init process434gitlab # [ 0.924030] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 1.027198] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.182076] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.258913] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.258994] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.259078] systemd[1]: Detected architecture arm64.440gitlab # [ 1.259094] systemd[1]: Running in initrd.441gitlab # [ 1.260150] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.260707] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.308283] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.427187] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.511338] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.581383] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.581846] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.596087] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.618798] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.619357] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.619411] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.619430] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.619515] systemd[1]: Reached target Path Units.454gitlab # [ 1.619546] systemd[1]: Reached target Slice Units.455gitlab # [ 1.619567] systemd[1]: Reached target Swaps.456gitlab # [ 1.619590] systemd[1]: Reached target Timer Units.457gitlab # [ 1.619830] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.620018] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.620190] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.620353] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.620463] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.620487] systemd[1]: Reached target Socket Units.463gitlab # [ 1.622910] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.625389] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.625486] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.627901] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.659908] systemd[1]: Starting Journal Service...468gitlab # [ 1.665304] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.665663] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.669425] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.676117] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.679087] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.680311] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.681019] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.686707] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.698329] systemd-journald[95]: Collecting audit messages is disabled.477gitlab # [ 1.722325] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.478gitlab # [ 1.723000] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev479gitlab # [ 1.729350] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0480gitlab # [ 1.729711] [drm] features: -virgl +edid -resource_blob -host_visible481gitlab # [ 1.729720] [drm] features: -context_init482gitlab # [ 1.732395] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.483gitlab # [ 1.736195] [drm] number of scanouts: 1484gitlab # [ 1.736236] [drm] number of cap sets: 0485gitlab # [ 1.738955] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic486gitlab # [ 1.738982] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0487gitlab # [ 1.743414] systemd[1]: Starting Create Static Device Nodes in /dev...488gitlab # [ 1.746051] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.753932] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.770847] systemd[1]: Started Journal Service.491gitlab # [ 1.767802] systemd-modules-load[96]: Using 4 probe threads492gitlab # [ 1.771681] systemd-modules-load[96]: Module 'virtio_balloon' is built in493gitlab # [ 1.773013] systemd-modules-load[96]: Module 'virtio_console' is built in494gitlab # [ 1.774225] systemd-modules-load[96]: Module 'virtio_rng' is built in495gitlab # [ 1.775911] systemd-modules-load[96]: Inserted module 'dm_mod'496gitlab # [ 1.777915] systemd-modules-load[96]: Inserted module 'virtio_gpu'497gitlab # [ 1.781532] systemd[1]: Finished Load Kernel Modules.498gitlab # [ 1.789411] systemd[1]: Starting Apply Kernel Variables...499gitlab # [ 1.791207] systemd[1]: Finished Create Static Device Nodes in /dev.500gitlab # [ 1.792739] systemd[1]: Reached target Preparation for Local File Systems.501gitlab # [ 1.793730] systemd[1]: Reached target Local File Systems.502gitlab # [ 1.798172] systemd[1]: Starting Create System Files and Directories...503gitlab # [ 1.816742] systemd[1]: Starting Rule-based Manager for Device Events and Files...504gitlab # [ 1.836193] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.838359] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.877681] systemd-udevd[116]: Using default interface naming scheme 'v261'.507gitlab # [ 1.902148] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.936661] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 2.000172] systemd-vconsole-setup[131]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 2.004415] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.410545] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.413179] systemd[1]: Reached target System Initialization.513gitlab # [ 2.415607] systemd[1]: Reached target Basic System.514gitlab # [ 2.622796] (udev-worker)[125]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.625969] (udev-worker)[125]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.642066] (udev-worker)[141]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.648250] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.649577] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.650914] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.667714] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.694973] systemd-fsck[153]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.699688] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.702104] systemd[1]: Mounting /sysroot...524gitlab # [ 2.745525] EXT4-fs (vda): mounted filesystem c5a0b0b6-79c5-4d76-b586-5ce5495ae722 r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.744644] systemd[1]: Mounted /sysroot.526gitlab # [ 2.747118] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.750759] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.752755] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.759968] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.773486] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.780303] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.792147] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.793563] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.794727] systemd[1]: Starting rw-sysroot-nix-store.service...535gitlab # [ 2.795594] systemd[1]: Mounted /sysroot/tmp/shared.536gitlab # [ 2.800130] systemd[1]: Mounted /sysroot/tmp/xchg.537gitlab # [ 2.806835] erofs (device vdb): mounted with root inode @ nid 128.538gitlab # [ 2.807123] systemd[1]: Mounted /sysroot/nix/.ro-store.539gitlab # [ 2.810797] systemd[1]: Mounted /sysroot/run.540gitlab # [ 2.811611] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.541gitlab # [ 2.815083] systemd[1]: Finished rw-sysroot-nix-store.service.542gitlab # [ 2.816377] systemd-sysroot-fstab-check[168]: /sysroot should be mounted in the initrd, will request daemon-reload.543gitlab # [ 2.817776] systemd[1]: Reload requested from client PID 168 ('systemd-sysroot') (unit initrd-parse-etc.service)...544gitlab # [ 2.819263] systemd[1]: Reloading...545gitlab # [ 2.922197] systemd[1]: Reloading finished in 106 ms.546gitlab # [ 2.980253] systemd-sysroot-fstab-check[168]: Requesting initrd-fs.target/start/replace...547gitlab # [ 2.982504] systemd-sysroot-fstab-check[168]: Requesting swap.target/start/replace...548gitlab # [ 2.984613] systemd[1]: initrd-parse-etc.service: Deactivated successfully.549gitlab # [ 2.986743] systemd[1]: Finished Mountpoints Configured in the Real Root.550gitlab # [ 2.988334] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.551gitlab # [ 2.989485] systemd[1]: Starting rw-sysroot-nix-store.service...552gitlab # [ 3.008650] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 3.010090] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 3.214151] (udev-worker)[122]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 3.217932] (udev-worker)[122]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 3.224397] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 3.226069] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 3.226867] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 3.227841] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.265072] systemd-vconsole-setup[197]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 3.267565] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 3.677522] systemd[1]: Mounting /sysroot/nix/store...563gitlab # [ 3.753988] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 3.756379] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 3.758752] systemd[1]: Starting Find NixOS closure...566gitlab # [ 3.762274] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 3.810589] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 3.814331] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.569gitlab # [ 3.837635] systemd[1]: Finished Find NixOS closure.570gitlab # [ 3.840060] systemd[1]: Reached target Initrd Default Target.571gitlab # [ 3.842527] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...572gitlab # [ 3.918896] systemd[1]: Stopped target Initrd Default Target.573gitlab # [ 3.921612] systemd[1]: Stopped target Basic System.574gitlab # [ 3.923796] systemd[1]: Stopped target Initrd Root Device.575gitlab # [ 3.926257] systemd[1]: Stopped target Path Units.576gitlab # [ 3.928436] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.577gitlab # [ 3.931591] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.578gitlab # [ 3.934922] systemd[1]: Stopped target Slice Units.579gitlab # [ 3.937124] systemd[1]: Stopped target Socket Units.580gitlab # [ 3.941129] systemd[1]: Stopped target System Initialization.581gitlab # [ 3.947914] systemd[1]: Stopped target Swaps.582gitlab # [ 3.949951] systemd[1]: Stopped target Timer Units.583gitlab # [ 3.956318] systemd[1]: dbus.socket: Deactivated successfully.584gitlab # [ 3.959430] systemd[1]: Closed D-Bus System Message Bus Socket.585gitlab # [ 3.962729] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.586gitlab # [ 3.966519] systemd[1]: Stopped Find NixOS closure.587gitlab # [ 3.969646] systemd[1]: Starting Load Kernel Module 9pnet_virtio...588gitlab # [ 3.974073] systemd[1]: Starting rw-sysroot-nix-store.service...589gitlab # [ 3.977407] systemd[1]: systemd-sysctl.service: Deactivated successfully.590gitlab # [ 3.979877] systemd[1]: Stopped Apply Kernel Variables.591gitlab # [ 3.981826] systemd[1]: systemd-modules-load.service: Deactivated successfully.592gitlab # [ 3.984114] systemd[1]: Stopped Load Kernel Modules.593gitlab # [ 3.986944] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.594gitlab # [ 3.989523] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.595gitlab # [ 3.991855] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.596gitlab # [ 3.994156] systemd[1]: Stopped Create System Files and Directories.597gitlab # [ 3.996097] systemd[1]: Stopped target Local File Systems.598gitlab # [ 3.997774] systemd[1]: Stopped target Preparation for Local File Systems.599gitlab # [ 3.999819] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.600gitlab # [ 4.002159] systemd[1]: Stopped Coldplug All udev Devices.601gitlab # [ 4.003861] systemd[1]: Stopping Rule-based Manager for Device Events and Files...602gitlab # [ 4.006221] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.603gitlab # [ 4.008480] systemd[1]: Stopped Virtual Console Setup.604gitlab # [ 4.010152] systemd[1]: initrd-cleanup.service: Deactivated successfully.605gitlab # [ 4.012539] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.606gitlab # [ 4.014536] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.607gitlab # [ 4.016710] systemd[1]: Finished Load Kernel Module 9pnet_virtio.608gitlab # [ 4.018432] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 4.020438] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 4.021998] systemd[1]: systemd-udevd.service: Deactivated successfully.611gitlab # [ 4.023955] systemd[1]: Stopped Rule-based Manager for Device Events and Files.612gitlab # [ 4.025764] systemd[1]: systemd-udevd.service: Consumed 2.344s CPU time over 2.165s wall clock time, 31.7M memory peak.613gitlab # [ 4.028358] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.614gitlab # [ 4.030159] systemd[1]: Closed udev Control Socket.615gitlab # [ 4.031456] systemd[1]: Starting Cleanup udev Database...616gitlab # [ 4.032902] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.617gitlab # [ 4.034789] systemd[1]: Stopped Create Static Device Nodes in /dev.618gitlab # [ 4.036409] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.619gitlab # [ 4.038414] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.620gitlab # [ 4.040227] systemd[1]: kmod-static-nodes.service: Deactivated successfully.621gitlab # [ 4.041940] systemd[1]: Stopped Create List of Static Device Nodes.622gitlab # [ 4.086982] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.623gitlab # [ 4.089733] systemd[1]: Finished Cleanup udev Database.624gitlab # [ 4.091481] systemd[1]: Reached target Switch Root.625gitlab # [ 4.093396] systemd[1]: Starting NixOS Activation...626gitlab # [ 4.299557] initrd-nixos-activation-start[222]: booting system configuration /nix/store/xvdaqsfjgmb4472jdz6nm0rpgrjkdsac-nixos-system-gitlab-test627gitlab # [ 4.369422] initrd-nixos-activation-start[222]: running activation script...628gitlab # [ 4.756750] initrd-nixos-activation-start[245]: setting up /etc...629gitlab # [ 4.929148] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.630gitlab # [ 4.932495] systemd[1]: Finished NixOS Activation.631gitlab # [ 4.934823] systemd[1]: Starting Switch Root...632gitlab # [ 4.981312] systemd[1]: Switching root.633gitlab # [ 5.080924] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).634gitlab # [ 5.754772] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)635gitlab # [ 5.754925] systemd[1]: Detected virtualization qemu.636gitlab # [ 5.755032] systemd[1]: Detected architecture arm64.637gitlab # [ 5.755283] systemd[1]: Detected first boot.638gitlab # [ 5.756654] systemd[1]: Initializing machine ID from random generator.639gitlab # [ 6.010389] systemd[1]: bpf-restrict-fs: LSM BPF program attached640gitlab # [ 6.129073] systemd[1]: Applying preset policy.641gitlab # [ 6.367039] systemd[1]: Populated /etc with preset unit settings.642gitlab # [ 6.537207] systemd[1]: initrd-switch-root.service: Deactivated successfully.643gitlab # [ 6.537711] systemd[1]: Stopped initrd-switch-root.service.644gitlab # [ 6.540623] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.645gitlab # [ 6.544745] systemd[1]: Created slice Slice /system/getty.646gitlab # [ 6.551912] systemd[1]: Created slice GitLab DevOps Platform Slice.647gitlab # [ 6.555821] systemd[1]: Created slice User and Session Slice.648gitlab # [ 6.556109] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.649gitlab # [ 6.557005] systemd[1]: Started Forward Password Requests to Wall Directory Watch.650gitlab # [ 6.557816] systemd[1]: Expecting device /dev/hvc0...651gitlab # [ 6.558700] systemd[1]: Expecting device /dev/ttyAMA0...652gitlab # [ 6.559625] systemd[1]: Reached target Local Encrypted Volumes.653gitlab # [ 6.560450] systemd[1]: Stopped target initrd-fs.target.654gitlab # [ 6.561269] systemd[1]: Stopped target initrd-root-fs.target.655gitlab # [ 6.562099] systemd[1]: Stopped target initrd-switch-root.target.656gitlab # [ 6.562964] systemd[1]: Reached target Virtual Machines and Containers.657gitlab # [ 6.563791] systemd[1]: Reached target Path Units.658gitlab # [ 6.564778] systemd[1]: Reached target Remote File Systems.659gitlab # [ 6.565597] systemd[1]: Reached target Slice Units.660gitlab # [ 6.566424] systemd[1]: Reached target Swaps.661gitlab # [ 6.568430] systemd[1]: Listening on Query the User Interactively for a Password.662gitlab # [ 6.570092] systemd[1]: Listening on Process Core Dump Socket.663gitlab # [ 6.572014] systemd[1]: Listening on Credential Encryption/Decryption.664gitlab # [ 6.576203] systemd[1]: Listening on Factory Reset Management.665gitlab # [ 6.577600] systemd[1]: Listening on Hostname Service Socket.666gitlab # [ 6.586731] systemd[1]: Starting Journal Log Access Socket...667gitlab # [ 6.588700] systemd[1]: Listening on Journal Audit Socket.668gitlab # [ 6.590823] systemd[1]: Listening on Console Output Muting Service Socket.669gitlab # [ 6.591656] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.670gitlab # [ 6.592229] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os671gitlab # [ 6.592882] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki672gitlab # [ 6.596066] systemd[1]: Listening on Disk Repartitioning Service Socket.673gitlab # [ 6.596784] systemd[1]: Listening on udev Control Socket.674gitlab # [ 6.597540] systemd[1]: Listening on udev Varlink Socket.675gitlab # [ 6.607937] systemd[1]: Mounting Huge Pages File System...676gitlab # [ 6.614637] systemd[1]: Mounting POSIX Message Queue File System...677gitlab # [ 6.622036] systemd[1]: Mounting Kernel Debug File System...678gitlab # [ 6.631430] systemd[1]: Mounting Kernel Trace File System...679gitlab # [ 6.654369] systemd[1]: Starting Create List of Static Device Nodes...680gitlab # [ 6.659699] systemd[1]: Starting Load Kernel Module 9pnet_virtio...681gitlab # [ 6.663362] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs682gitlab # [ 6.675307] systemd[1]: Mounting Kernel Configuration File System...683gitlab # [ 6.675896] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm684gitlab # [ 6.679003] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore685gitlab # [ 6.686663] systemd[1]: Starting Load Kernel Module fuse...686gitlab # [ 6.687345] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67687gitlab # [ 6.698530] systemd[1]: Starting Journal Service...688gitlab # [ 6.702631] systemd[1]: Starting Load Kernel Modules...689gitlab # [ 6.710802] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...690gitlab # [ 6.719333] systemd[1]: Starting Remount Root and Kernel File Systems...691gitlab # [ 6.720000] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os692gitlab # [ 6.733288] systemd[1]: Starting Coldplug All udev Devices...693gitlab # [ 6.737165] systemd[1]: Listening on Journal Log Access Socket.694gitlab # [ 6.737901] systemd[1]: Mounted Huge Pages File System.695gitlab # [ 6.738793] systemd[1]: Mounted POSIX Message Queue File System.696gitlab # [ 6.739671] systemd[1]: Mounted Kernel Debug File System.697gitlab # [ 6.740505] systemd[1]: Mounted Kernel Trace File System.698gitlab # [ 6.741757] systemd[1]: Finished Create List of Static Device Nodes.699gitlab # [ 6.742570] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.700gitlab # [ 6.743439] systemd[1]: Finished Load Kernel Module 9pnet_virtio.701gitlab # [ 6.744308] systemd[1]: Mounted Kernel Configuration File System.702gitlab # [ 6.750650] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...703gitlab # [ 6.755920] fuse: init (API version 7.45)704gitlab # [ 6.766086] systemd[1]: modprobe@fuse.service: Deactivated successfully.705gitlab # [ 6.766896] systemd[1]: Finished Load Kernel Module fuse.706gitlab # [ 6.781742] systemd[1]: Mounting FUSE Control File System...707gitlab # [ 6.785323] systemd[1]: Finished Load Kernel Modules.708gitlab # [ 6.791505] systemd[1]: Starting Firewall...709gitlab # [ 6.797678] systemd[1]: Starting Apply Kernel Variables...710gitlab # [ 6.799073] systemd-journald[316]: Collecting audit messages is enabled.711gitlab # [ 6.805107] EXT4-fs (vda): re-mounted c5a0b0b6-79c5-4d76-b586-5ce5495ae722.712gitlab # [ 6.818725] systemd[1]: Queued start job for default target Multi-User System.713gitlab # [ 6.820243] systemd[1]: Unnecessary job was removed for /dev/vdb.714gitlab # [ 6.825209] systemd[1]: Finished Remount Root and Kernel File Systems.715gitlab # [ 6.827538] systemd[1]: Started Journal Service.716gitlab # [ 6.822505] systemd[1]: systemd-journald.service: Deactivated successfully.717gitlab # [ 6.829262] systemd-modules-load[317]: Using 3 probe threads718gitlab # [ 6.830300] systemd-modules-load[317]: Module 'atkbd' is built in719gitlab # [ 6.831899] systemd-modules-load[317]: Module 'loop' is built in720gitlab # [ 6.833263] systemd-modules-load[317]: Inserted module 'tls'721gitlab # [ 6.834330] systemd[1]: Mounted FUSE Control File System.722gitlab # [ 6.835645] systemd-oomd[318]: No swap; memory pressure usage will be degraded723gitlab # [ 6.838319] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.724gitlab # [ 6.841717] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.725gitlab # [ 6.850243] systemd[1]: Finished Apply Kernel Variables.726gitlab # [ 6.854483] systemd[1]: Listening on Disk Image Download Service Socket.727gitlab # [ 6.859800] systemd[1]: Starting Flush Journal to Persistent Storage...728gitlab # [ 6.861247] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore729gitlab # [ 6.863009] systemd[1]: Starting Load/Save OS Random Seed...730gitlab # [ 6.869191] systemd[1]: Starting Create Static Device Nodes in /dev...731gitlab # [ 6.871551] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os732gitlab # [ 6.898700] systemd-journald[316]: Received client request to flush runtime journal.733gitlab # [ 6.929681] systemd[1]: Finished Load/Save OS Random Seed.734gitlab # [ 6.931475] systemd[1]: Finished Create Static Device Nodes in /dev.735gitlab # [ 6.934337] systemd[1]: Reached target First Boot Complete.736gitlab # [ 6.936055] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 6.937978] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 6.940365] systemd[1]: Finished Flush Journal to Persistent Storage.739gitlab # [ 6.967932] systemd-udevd[361]: Using default interface naming scheme 'v261'.740gitlab # [ 7.011788] systemd[1]: Started Rule-based Manager for Device Events and Files.741gitlab # [ 7.392925] systemd[1]: Finished Firewall.742gitlab # [ 7.396095] systemd[1]: Finished Coldplug All udev Devices.743gitlab # [ 7.481267] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs744gitlab # [ 7.540397] systemd[1]: Mounting /run/wrappers...745gitlab # [ 7.558989] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.746gitlab # [ 7.584667] (udev-worker)[464]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.747gitlab # [ 7.590203] (udev-worker)[464]: Network interface NamePolicy= disabled on kernel command line.748gitlab # [ 7.603052] (udev-worker)[396]: Network interface NamePolicy= disabled on kernel command line.749gitlab # [ 7.611815] systemd[1]: Mounted /run/wrappers.750gitlab # [ 7.613409] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.751gitlab # [ 7.615899] systemd[1]: Reached target Local File Systems.752gitlab # [ 7.617488] systemd[1]: Listening on Boot Loader Control Service Socket.753gitlab # [ 7.623579] systemd[1]: Starting register-nix-paths.service...754gitlab # [ 7.628052] systemd[1]: Starting Create SUID/SGID Wrappers...755gitlab # [ 7.629130] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.756gitlab # [ 7.631082] systemd[1]: Starting Save Transient machine-id to Disk...757gitlab # [ 7.658960] systemd[1]: Starting Create System Files and Directories...758gitlab # [ 7.664129] systemd[1]: Condition check resulted in Virtio network device being skipped.759gitlab # [ 7.672338] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore760gitlab # [ 7.679720] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.761gitlab # [ 7.681214] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67762gitlab # [ 7.685102] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore763gitlab # [ 7.687145] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os764gitlab # [ 7.689867] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os765gitlab # [ 7.696146] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.766gitlab # [ 7.701292] systemd[1]: Finished Save Transient machine-id to Disk.767gitlab # [ 7.716435] systemd[1]: Finished Create System Files and Directories.768gitlab # [ 7.725175] systemd[1]: Starting Rebuild Journal Catalog...769gitlab # [ 7.732993] systemd[1]: Starting Record System Boot/Shutdown in UTMP...770gitlab # [ 7.744255] mousedev: PS/2 mouse device common for all mice771gitlab # [ 7.761226] systemd[1]: Finished Record System Boot/Shutdown in UTMP.772gitlab # [ 7.783175] systemd[1]: Finished Rebuild Journal Catalog.773gitlab # [ 7.787393] systemd[1]: Starting Update is Completed...774gitlab # [ 7.821947] systemd[1]: Finished Update is Completed.775gitlab # [ 7.883069] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.776gitlab # [ 7.885975] systemd[1]: Finished Create SUID/SGID Wrappers.777gitlab # [ 7.887433] systemd[1]: suid-sgid-wrappers.service: Consumed 169ms CPU time over 258ms wall clock time, 6.1M memory peak, 1.9M read from disk.778gitlab # [ 8.307120] systemd[1]: Finished register-nix-paths.service.779gitlab # [ 8.309300] systemd[1]: Reached target System Initialization.780gitlab # [ 8.310318] systemd[1]: Started Discard unused filesystem blocks once a week.781gitlab # [ 8.311612] systemd[1]: Started logrotate.timer.782gitlab # [ 8.313032] systemd[1]: Started Daily Cleanup of Temporary Directories.783gitlab # [ 8.314024] systemd[1]: Reached target Timer Units.784gitlab # [ 8.314763] systemd[1]: Listening on D-Bus System Message Bus Socket.785gitlab # [ 8.316434] systemd[1]: Listening on Nix Daemon Socket.786gitlab # [ 8.342416] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3787gitlab # [ 8.362556] systemd[1]: Starting nixbot CI service socket...788gitlab # [ 8.363552] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.789gitlab # [ 8.364885] systemd[1]: Listening on nixbot CI service socket.790gitlab # [ 8.373713] systemd[1]: Reached target Socket Units.791gitlab # [ 8.376384] systemd[1]: Starting D-Bus System Message Bus...792gitlab # [ 8.378107] systemd[1]: Starting Virtual Console Setup...793gitlab # [ 8.427507] dbus-broker-launch[564]: Looking up NSS user entry for 'systemd-timesync'...794gitlab # [ 8.429562] dbus-broker-launch[564]: NSS returned no entry for 'systemd-timesync'795gitlab # [ 8.430687] dbus-broker-launch[564]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"796gitlab # [ 8.433134] systemd[1]: Started D-Bus System Message Bus.797gitlab # [ 8.434615] systemd-vconsole-setup[565]: Configuration of first virtual console was skipped, ignoring remaining ones.798gitlab # [ 8.447849] dbus-broker-launch[564]: Ready799gitlab # [ 8.448941] systemd[1]: Finished Virtual Console Setup.800gitlab # [ 8.451052] systemd[1]: Reached target Basic System.801gitlab # [ 8.454065] systemd[1]: Started backdoor.service.802gitlab # [ 8.457108] systemd[1]: Starting gitlab-config.service...803gitlab # [ 8.461548] systemd[1]: Starting Import lastlog data into lastlog2 database...804gitlab # [ 8.484336] systemd[1]: Starting Logrotate configuration check...805gitlab # [ 8.491487] systemd[1]: Starting Name Service Cache Daemon (nsncd)...806gitlab # [ 8.500271] systemd[1]: Starting Post-Boot Actions...807gitlab # [ 8.507759] systemd[1]: Started Reset console on configuration changes.808gitlab # [ 8.518282] logrotate[572]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.809gitlab # connecting to host...810gitlab # [ 8.526630] logrotate[572]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf811gitlab # [ 8.528055] logrotate[572]: note: 'monthly' overrides previously specified 'weekly'812gitlab # [ 8.529161] logrotate[572]: Reading state from file: /var/lib/logrotate.status813gitlab # [ 8.530103] logrotate[572]: state file /var/lib/logrotate.status does not exist814gitlab # [ 8.531060] logrotate[572]: Allocating hash table for state file, size 64 entries815gitlab # [ 8.532479] logrotate[572]: Handling 4 logs816gitlab # [ 8.533897] logrotate[572]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed817gitlab # [ 8.536161] logrotate[572]: considering log /var/log/btmp818gitlab # [ 8.536989] logrotate[572]: Creating new state819gitlab # [ 8.537581] logrotate[572]: Now: 2026-09-01 10:26820gitlab # [ 8.538609] logrotate[572]: Last rotated at 2026-09-01 10:00821gitlab # [ 8.539591] logrotate[572]: log does not need rotating (log has already been rotated)822gitlab # [ 8.540878] logrotate[572]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed823gitlab # [ 8.543210] logrotate[572]: considering log /var/log/wtmp824gitlab # [ 8.544536] logrotate[572]: Creating new state825gitlab # [ 8.545244] logrotate[572]: Now: 2026-09-01 10:26826gitlab # [ 8.548470] logrotate[572]: Last rotated at 2026-09-01 10:00827gitlab # [ 8.549388] logrotate[572]: log does not need rotating (log has already been rotated)828gitlab: Guest shell says: b'Spawning backdoor root shell...\n'829gitlab # [ 8.550550] logrotate[572]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed830gitlab # [ 8.552420] logrotate[572]: switching euid from 0 to 165 and egid from 0 to 165 (pid 572)831gitlab # [ 8.553456] logrotate[572]: considering log /var/gitlab/state/log/*.log832gitlab # [ 8.554260] logrotate[572]: log /var/gitlab/state/log/*.log does not exist -- skipping833gitlab: connected to guest root shell834gitlab # [ 8.555305] logrotate[572]: Creating new state835gitlab: (connecting took 9.05 seconds)836gitlab # [ 8.555888] logrotate[572]: switching euid from 165 to 0 and egid from 165 to 0 (pid 572)837gitlab: (finished: waiting for the VM to finish booting, in 9.05 seconds)838gitlab # [ 8.557329] logrotate[572]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed839gitlab # [ 8.558843] logrotate[572]: switching euid from 0 to 60 and egid from 0 to 60 (pid 572)840gitlab # [ 8.559803] logrotate[572]: considering log /var/log/nginx/*.log841gitlab # [ 8.561129] logrotate[572]: log /var/log/nginx/*.log does not exist -- skipping842gitlab # [ 8.562057] logrotate[572]: Creating new state843gitlab # [ 8.562642] logrotate[572]: not running postrotate script, since no logs were rotated844gitlab # [ 8.563641] logrotate[572]: switching euid from 60 to 0 and egid from 60 to 0 (pid 572)845gitlab # [ 8.565333] systemd[1]: Starting resolvconf update...846gitlab # [ 8.566586] nsncd[573]: Sep 01 10:26:49.292 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"847gitlab # [ 8.568490] systemd[1]: Finished Logrotate configuration check.848gitlab # [ 8.569415] systemd[1]: Finished Post-Boot Actions.849gitlab # [ 8.570196] systemd[1]: Finished Import lastlog data into lastlog2 database.850gitlab # [ 8.571206] systemd[1]: Started Name Service Cache Daemon (nsncd).851gitlab # [ 8.572790] systemd[1]: Reached target Host and Network Name Lookups.852gitlab # [ 8.573706] systemd[1]: Reached target User and Group Name Lookups.853gitlab # [ 8.574526] systemd[1]: Starting User Login Management...854gitlab # [ 8.631353] systemd[1]: Stopped target Host and Network Name Lookups.855gitlab # [ 8.632780] systemd[1]: Stopping Host and Network Name Lookups...856gitlab # [ 8.633697] systemd[1]: Stopped target User and Group Name Lookups.857gitlab # [ 8.634715] systemd[1]: Stopping User and Group Name Lookups...858gitlab # [ 8.635636] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...859gitlab # [ 8.636745] systemd[1]: nscd.service: Deactivated successfully.860gitlab # [ 8.637589] systemd[1]: Stopped Name Service Cache Daemon (nsncd).861gitlab # [ 8.638441] systemd[1]: nscd.service: Consumed 35ms CPU time over 144ms wall clock time, 7.4M memory peak, 5.8M read from disk.862gitlab # [ 8.640837] systemd-logind[611]: New seat seat0.863gitlab # [ 8.646329] systemd-logind[611]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)864gitlab # [ 8.647781] systemd-logind[611]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)865gitlab # [ 8.652651] systemd-logind[611]: Watching system buttons on /dev/input/event0 (gpio-keys)866gitlab # [ 8.653931] systemd[1]: Starting Name Service Cache Daemon (nsncd)...867gitlab # [ 8.654832] systemd[1]: Started User Login Management.868gitlab # [ 8.660361] systemd[1]: Starting linger-users.service...869gitlab # [ 8.690821] systemd[1]: Started Name Service Cache Daemon (nsncd).870gitlab # [ 8.692706] nsncd[661]: Sep 01 10:26:49.419 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"871gitlab # [ 8.695171] systemd[1]: Finished resolvconf update.872gitlab # [ 8.696380] systemd[1]: linger-users.service: Deactivated successfully.873gitlab # [ 8.698724] systemd[1]: Finished linger-users.service.874gitlab # [ 8.699501] systemd[1]: Reached target Preparation for Network.875gitlab # [ 8.700409] systemd[1]: Reached target Host and Network Name Lookups.876gitlab # [ 8.701398] systemd[1]: Reached target User and Group Name Lookups.877gitlab # [ 8.702260] systemd[1]: Starting DHCP Client...878gitlab # [ 8.704460] systemd[1]: Starting Address configuration of eth1...879gitlab # [ 8.709470] systemd[1]: Starting Extra networking commands....880gitlab # [ 8.748048] network-addresses-eth1-start[690]: adding address 192.168.1.1/24... done881gitlab # [ 8.753246] network-addresses-eth1-start[690]: adding address 2001:db8:1::1/64... done882gitlab # [ 8.760790] systemd[1]: Finished Address configuration of eth1.883gitlab # [ 8.792184] dhcpcd[699]: dhcpcd-10.3.2 starting884gitlab # [ 8.795560] dhcpcd[749]: dev: loaded udev885gitlab # [ 8.807381] systemd[1]: Finished Extra networking commands..886gitlab # [ 8.808745] systemd[1]: Reached target Network.887gitlab # [ 8.811924] 8021q: 802.1Q VLAN Support v1.8888gitlab # [ 8.812378] 8021q: adding VLAN 0 to HW filter on device eth1889gitlab # [ 8.812731] systemd[1]: Starting gitlab-workhorse.service...890gitlab # [ 8.816545] systemd[1]: Starting Nginx Web Server...891gitlab # [ 8.830333] systemd[1]: Starting PostgreSQL Server...892gitlab # [ 8.832099] systemd[1]: Starting Redis Server - redis-gitlab...893gitlab # [ 8.836791] systemd[1]: Starting Permit User Sessions...894gitlab # [ 8.847574] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.895gitlab # [ 8.853930] cfg80211: Loading compiled-in X.509 certificates for regulatory database896gitlab # [ 8.860812] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'897gitlab # [ 8.861355] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'898gitlab # [ 8.865501] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2899gitlab # [ 8.865851] cfg80211: failed to load regulatory.db900gitlab # [ 8.876711] systemd[1]: Finished Permit User Sessions.901gitlab # [ 8.894278] systemd[1]: Started Getty on tty1.902gitlab # [ 8.895188] systemd[1]: Reached target Login Prompts.903gitlab # [ 8.920812] dhcpcd[749]: eth0: waiting for carrier[ 8.923096] 8021q: adding VLAN 0 to HW filter on device eth0904gitlab # 905gitlab # [ 8.923508] dhcpcd[749]: eth0: carrier acquired906gitlab # [ 8.927212] dhcpcd[749]: DUID 00:01:00:01:32:29:64:e9:52:54:00:12:34:56907gitlab # [ 8.928404] dhcpcd[749]: eth0: IAID 00:12:34:56908gitlab # [ 8.929209] dhcpcd[749]: eth0: adding address fe80::5054:ff:fe12:3456909gitlab # [ 9.017461] nginx-pre-start[792]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok910gitlab # [ 9.019314] nginx-pre-start[792]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful911gitlab # [ 9.025072] systemd[1]: Started Nginx Web Server.912gitlab # [ 9.039677] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.913gitlab # [ 9.042479] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo914gitlab # [ 9.043845] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started915gitlab # [ 9.047427] systemd[1]: Started Redis Server - redis-gitlab.916gitlab # [ 9.048370] redis-server[789]: Configuration loaded917gitlab # [ 9.049313] redis[789]: monotonic clock: ARM CNTVCT @ 1000 ticks/us918gitlab # [ 9.050471] redis[789]: Running mode=standalone, port=0.919gitlab # [ 9.051359] redis[789]: Server initialized920gitlab # [ 9.052231] redis[789]: Ready to accept connections unix921gitlab # [ 9.053138] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.922gitlab # [ 9.059578] postgresql-pre-start[794]: The files belonging to this database system will be owned by user "postgres".923gitlab # [ 9.061546] postgresql-pre-start[794]: This user must also own the server process.924gitlab # [ 9.063773] postgresql-pre-start[794]: The database cluster will be initialized with locale "en_US.UTF-8".925gitlab # [ 9.065099] postgresql-pre-start[794]: The default database encoding has accordingly been set to "UTF8".926gitlab # [ 9.066441] postgresql-pre-start[794]: The default text search configuration will be set to "english".927gitlab # [ 9.067763] postgresql-pre-start[794]: Data page checksums are enabled.928gitlab # [ 9.068771] postgresql-pre-start[794]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok929gitlab # [ 9.070073] postgresql-pre-start[794]: creating subdirectories ... ok930gitlab # [ 9.071002] postgresql-pre-start[794]: selecting dynamic shared memory implementation ... posix931gitlab # [ 9.107082] postgresql-pre-start[794]: selecting default "max_connections" ... 100932gitlab # [ 9.166761] postgresql-pre-start[794]: selecting default "shared_buffers" ... 128MB933gitlab # [ 9.574698] systemd[1]: Started gitlab-workhorse.service.934gitlab # [ 9.585794] dhcpcd[749]: eth0: soliciting a DHCP lease935gitlab # [ 9.605391] dhcpcd[749]: eth0: offered 10.0.2.15 from 10.0.2.2936gitlab # [ 9.620893] dhcpcd[749]: eth0: probing address 10.0.2.15/24937gitlab # [ 9.721715] postgresql-pre-start[794]: selecting default time zone ... UTC938gitlab # [ 9.725671] postgresql-pre-start[794]: creating configuration files ... ok939gitlab # [ 9.889959] gitlab-workhorse[817]: time="2026-09-01T10:26:50Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4940gitlab # [ 9.895425] gitlab-workhorse[817]: time="2026-09-01T10:26:50Z" level=info msg="Using redis/go-redis"941gitlab # [ 9.900177] gitlab-workhorse[817]: time="2026-09-01T10:26:50Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix942gitlab # [ 10.017906] postgresql-pre-start[794]: running bootstrap script ... ok943gitlab # [ 10.736978] postgresql-pre-start[794]: performing post-bootstrap initialization ... ok944gitlab # [ 10.997764] postgresql-pre-start[794]: syncing data to disk ... ok945gitlab # [ 11.000675] postgresql-pre-start[794]: initdb: warning: enabling "trust" authentication for local connections946gitlab # [ 11.004910] postgresql-pre-start[794]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.947gitlab # [ 11.011611] postgresql-pre-start[794]: Success. You can now start the database server using:948gitlab # [ 11.015191] postgresql-pre-start[794]: pg_ctl -D /var/lib/postgresql/18 -l logfile start949gitlab # [ 11.217220] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit950gitlab # [ 11.222907] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432951gitlab # [ 11.226401] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432952gitlab # [ 11.229934] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"953gitlab # [ 11.235393] postgres[860]: [860] LOG: database system was shut down at 2026-09-01 10:26:51 GMT954gitlab # [ 11.243902] postgres[851]: [851] LOG: database system is ready to accept connections955gitlab # [ 11.249582] systemd[1]: Started PostgreSQL Server.956gitlab # [ 11.254169] systemd[1]: Starting PostgreSQL Setup Scripts...957gitlab # [ 11.340896] dhcpcd[749]: eth0: soliciting an IPv6 router958gitlab # [ 11.343431] dhcpcd[749]: eth0: Router Advertisement from fe80::2959gitlab # [ 11.346358] dhcpcd[749]: eth0: adding address fec0::5054:ff:fe12:3456/64960gitlab # [ 11.350857] dhcpcd[749]: eth0: adding route to fec0::/64961gitlab # [ 11.353327] dhcpcd[749]: eth0: adding default route via fe80::2962gitlab # [ 11.590969] postgresql-setup-start[871]: CREATE DATABASE963gitlab # [ 11.623379] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[876]: mkdir -p /var/gitlab/state/home/.ssh: OK964gitlab # [ 11.627764] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[876]: chmod 700 /var/gitlab/state/home/.ssh: OK965gitlab # [ 11.635325] postgresql-setup-start[882]: CREATE ROLE966gitlab # [ 11.663298] postgresql-setup-start[887]: ALTER DATABASE967gitlab # [ 11.701926] systemd[1]: Finished gitlab-config.service.968gitlab # [ 11.704353] postgresql-setup-start[899]: CREATE ROLE969gitlab # [ 11.709448] systemd[1]: Started gitaly.service.970gitlab # [ 11.711661] systemd[1]: Finished PostgreSQL Setup Scripts.971gitlab # [ 11.714374] systemd[1]: Reached target PostgreSQL.972gitlab # [ 11.719667] systemd[1]: Starting gitlab-db-config.service...973gitlab # [ 11.724380] systemd[1]: Starting gitlab-postgresql.service...974gitlab # [ 11.917733] gitlab-postgresql-start[917]: CREATE DATABASE975gitlab # [ 11.986029] gitlab-postgresql-start[927]: CREATE EXTENSION976gitlab # [ 12.083107] gitlab-postgresql-start[929]: CREATE EXTENSION977gitlab # [ 12.087444] systemd[1]: Finished gitlab-postgresql.service.978gitlab # [ 12.502733] gitaly[902]: time="2026-09-01T10:26:53.229Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=902979gitlab # [ 12.516419] gitaly[902]: time="2026-09-01T10:26:53.230Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=902980gitlab # [ 12.519528] gitaly[902]: time="2026-09-01T10:26:53.230Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=902981gitlab # [ 12.523525] gitaly[902]: time="2026-09-01T10:26:53.231Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=902982gitlab # [ 12.526769] gitaly[902]: time="2026-09-01T10:26:53.231Z" level=info msg="Starting Gitaly" pid=902 version=983gitlab # [ 12.789742] gitaly[902]: time="2026-09-01T10:26:53.517Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=285 pid=902984gitlab # [ 12.792172] gitaly[902]: time="2026-09-01T10:26:53.517Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=902985gitlab # [ 12.794000] gitaly[902]: time="2026-09-01T10:26:53.518Z" level=info msg="finished initializing command factory" duration_ms=0 pid=902986gitlab # [ 12.796090] gitaly[902]: time="2026-09-01T10:26:53.518Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-902/git-exec-3084237845.d/git pid=902987gitlab # [ 12.798795] gitaly[902]: time="2026-09-01T10:26:53.525Z" level=info msg="finished detecting git version" duration_ms=7 pid=902988gitlab # [ 12.801105] gitaly[902]: time="2026-09-01T10:26:53.525Z" level=info msg="using Git version" pid=902 version=2.53.g989gitlab # [ 12.803084] gitaly[902]: time="2026-09-01T10:26:53.525Z" level=info msg="clearing disk cache object folder" pid=902 storage=default990gitlab # [ 12.805460] gitaly[902]: time="2026-09-01T10:26:53.526Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3619932632 pid=902 storage=default991gitlab # [ 12.808934] gitaly[902]: time="2026-09-01T10:26:53.526Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3619932632 pid=902 storage=default992gitlab # [ 12.813638] gitaly[902]: time="2026-09-01T10:26:53.526Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=902993gitlab # [ 12.817271] gitaly[902]: time="2026-09-01T10:26:53.526Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=902994gitlab # [ 12.821087] gitaly[902]: time="2026-09-01T10:26:53.526Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3619932632 clear_duration_ms=0 pid=902 storage=default995gitlab # [ 12.824413] gitaly[902]: time="2026-09-01T10:26:53.541Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=902996gitlab # [ 12.827312] gitaly[902]: time="2026-09-01T10:26:53.541Z" level=info msg="counting repositories" pid=902997gitlab # [ 12.829169] gitaly[902]: time="2026-09-01T10:26:53.541Z" level=info msg="starting to count repositories" pid=902 storage_path=/var/gitlab/state/repositories998gitlab # [ 12.831546] gitaly[902]: time="2026-09-01T10:26:53.541Z" level=info msg="finished tempdir cleaner walk" pid=902 storage=default time_ms=0999gitlab # [ 12.833771] gitaly[902]: time="2026-09-01T10:26:53.541Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=902 schema=unix1000gitlab # [ 12.836304] gitaly[902]: time="2026-09-01T10:26:53.541Z" level=info msg="listening at address" address=/run/gitaly/gitaly-902/sock.d/intern pid=902 schema=unix1001gitlab # [ 12.838671] gitaly[902]: time="2026-09-01T10:26:53.541Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=902 storage_path=/var/gitlab/state/repositories1002gitlab # [ 12.841564] gitaly[902]: time="2026-09-01T10:26:53.542Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9021003gitlab # [ 12.843700] gitaly[902]: time="2026-09-01T10:26:53.543Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9021004gitlab # [ 12.845944] gitaly[902]: time="2026-09-01T10:26:53.543Z" level=info msg="Started Gitaly" duration_ms=312 pid=9021005gitlab # [ 12.847704] gitaly[902]: time="2026-09-01T10:26:53.544Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9021006gitlab # [ 12.849869] gitaly[902]: time="2026-09-01T10:26:53.544Z" level=info msg="maintenance: daily scheduled" pid=902 scheduled="2026-09-01 12:00:00 +0000 UTC"1007gitlab # [ 13.647860] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[908]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1008gitlab # [ 13.654921] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[908]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1009gitlab # [ 13.686564] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[908]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1010gitlab # [ 14.673394] dhcpcd[749]: eth0: leased 10.0.2.15 for 86400 seconds1011gitlab # [ 14.676386] dhcpcd[749]: eth0: adding route to 10.0.2.0/241012gitlab # [ 14.678673] dhcpcd[749]: eth0: adding default route via 10.0.2.21013gitlab # [ 14.896627] systemd[1]: Started DHCP Client.1014gitlab # [ 14.898148] systemd[1]: Reached target Network is Online.1015gitlab # [ 16.278271] gitaly[902]: time="2026-09-01T10:26:57.004Z" level=info msg="License database preloaded" duration_ms=3773 pid=9021016gitlab # [ 61.828708] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[908]: W, [2026-09-01T10:27:42.555094 #908] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1017gitlab # [ 65.043360] postgres[1462]: [1462] ERROR: relation "feature_gates" does not exist at character 5231018gitlab # [ 65.043743] postgres[1462]: [1462] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1019gitlab # [ 65.043867] postgres[1462]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1020gitlab # [ 65.043989] postgres[1462]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1021gitlab # [ 65.044196] postgres[1462]: attidentity AS identity,1022gitlab # [ 65.044309] postgres[1462]: attgenerated as attgenerated1023gitlab # [ 65.044429] postgres[1462]: FROM pg_attribute a1024gitlab # [ 65.044526] postgres[1462]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1025gitlab # [ 65.044662] postgres[1462]: LEFT JOIN pg_type t ON a.atttypid = t.oid1026gitlab # [ 65.044775] postgres[1462]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1027gitlab # [ 65.044886] postgres[1462]: WHERE a.attrelid = '"feature_gates"'::regclass1028gitlab # [ 65.044996] postgres[1462]: AND a.attnum > 0 AND NOT a.attisdropped1029gitlab # [ 65.045105] postgres[1462]: ORDER BY a.attnum1030gitlab # [ 65.045224] postgres[1462]:1031gitlab # [ 69.980499] gitlab-workhorse[817]: time="2026-09-01T10:27:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1032gitlab # [ 70.432850] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1513]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1033gitlab # [ 70.437252] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1513]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1034gitlab # [ 79.990766] gitlab-workhorse[817]: time="2026-09-01T10:28:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 89.998726] gitlab-workhorse[817]: time="2026-09-01T10:28:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1036gitlab # [ 96.558696] postgres[1616]: [1616] ERROR: relation "table_without_models" does not exist1037gitlab # [ 96.559318] postgres[1616]: [1616] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1038gitlab # [ 100.008961] gitlab-workhorse[817]: time="2026-09-01T10:28:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 110.010122] gitlab-workhorse[817]: time="2026-09-01T10:28:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 120.011323] gitlab-workhorse[817]: time="2026-09-01T10:28:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 129.161884] systemd[1]: Finished gitlab-db-config.service.1042gitlab # [ 129.170265] systemd[1]: Started gitlab-sidekiq.service.1043gitlab # [ 129.179333] systemd[1]: Starting gitlab.service...1044gitlab # [ 129.808461] bundle[2017]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1045gitlab # [ 129.809010] bundle[2017]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1046gitlab # [ 129.810779] bundle[2017]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1047gitlab # [ 130.014255] gitlab-workhorse[817]: time="2026-09-01T10:28:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1048gitlab # [ 134.455081] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-01T10:28:55.143Z","message":"Starting cluster with 1 processes"}1049gitlab # [ 134.525083] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.221Z","pid":2017,"message":"* Enabling systemd notification integration"}1050gitlab # [ 134.530202] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.251Z","pid":2017,"message":"Puma starting in cluster mode..."}1051gitlab # [ 134.535041] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.251Z","pid":2017,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1052gitlab # [ 134.539960] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.252Z","pid":2017,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1053gitlab # [ 134.550418] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.252Z","pid":2017,"message":"* Min threads: 0"}1054gitlab # [ 134.554914] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.252Z","pid":2017,"message":"* Max threads: 4"}1055gitlab # [ 134.558971] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.252Z","pid":2017,"message":"* Environment: production"}1056gitlab # [ 134.563463] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.252Z","pid":2017,"message":"* Master PID: 2017"}1057gitlab # [ 134.567379] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.252Z","pid":2017,"message":"* Workers: 2"}1058gitlab # [ 134.571255] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.252Z","pid":2017,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1059gitlab # [ 134.576254] bundle[2017]: {"timestamp":"2026-09-01T10:28:55.252Z","pid":2017,"message":"* Preloading application"}1060gitlab # [ 140.015416] gitlab-workhorse[817]: time="2026-09-01T10:29:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061gitlab # [ 150.026376] gitlab-workhorse[817]: time="2026-09-01T10:29:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 160.027577] gitlab-workhorse[817]: time="2026-09-01T10:29:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 170.029191] gitlab-workhorse[817]: time="2026-09-01T10:29:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 173.881486] bundle[2017]: W, [2026-09-01T10:29:34.608109 #2017] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1065gitlab # [ 178.397763] sidekiq-cluster[2060]: 2026-09-01T10:29:39.124Z pid=2060 tid=xpg INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2060, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>424472576}1066gitlab # [ 178.724564] sidekiq-cluster[2060]: W, [2026-09-01T10:29:39.452318 #2060] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1067gitlab # [ 178.886618] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:39.614Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1068gitlab # [ 180.030174] gitlab-workhorse[817]: time="2026-09-01T10:29:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1069gitlab # [ 182.308353] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.034Z","message":"GitLab reliable fetch activated!"}1070gitlab # [ 182.308723] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.035Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1071gitlab # [ 182.358833] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.086Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1072gitlab # [ 182.365914] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.091Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1073gitlab # [ 182.372621] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.098Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1074gitlab # [ 182.378463] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.105Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1075gitlab # [ 182.384386] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.111Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1076gitlab # [ 182.390465] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.118Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1077gitlab # [ 182.395439] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.123Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1078gitlab # [ 182.400487] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.128Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1079gitlab # [ 182.404645] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.132Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1080gitlab # [ 182.409098] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.136Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1081gitlab # [ 182.413801] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.140Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1082gitlab # [ 182.418289] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.145Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1083gitlab # [ 182.422456] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.149Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1084gitlab # [ 182.426907] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.153Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1085gitlab # [ 182.431037] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.156Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1086gitlab # [ 182.434978] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.160Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1087gitlab # [ 182.438518] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.165Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1088gitlab # [ 182.442873] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.170Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1089gitlab # [ 182.447884] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.175Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1090gitlab # [ 182.452658] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.180Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1091gitlab # [ 182.457651] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.185Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1092gitlab # [ 182.462127] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.190Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1093gitlab # [ 182.466652] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.194Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1094gitlab # [ 182.470676] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.198Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1095gitlab # [ 182.474702] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.201Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1096gitlab # [ 182.478313] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.205Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1097gitlab # [ 182.481604] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.208Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1098gitlab # [ 182.484839] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.212Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1099gitlab # [ 182.488530] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.216Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1100gitlab # [ 182.492085] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.220Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1101gitlab # [ 182.495509] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.223Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1102gitlab # [ 182.499006] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.226Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1103gitlab # [ 182.502092] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.230Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1104gitlab # [ 182.505359] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.233Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1105gitlab # [ 182.508364] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.235Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1106gitlab # [ 182.511290] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.238Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1107gitlab # [ 182.514417] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.241Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1108gitlab # [ 182.517326] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.243Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1109gitlab # [ 182.520083] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.246Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1110gitlab # [ 182.522716] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.248Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1111gitlab # [ 182.526649] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.251Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1112gitlab # [ 182.529311] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.253Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1113gitlab # [ 182.531976] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.255Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1114gitlab # [ 182.534661] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.258Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1115gitlab # [ 182.537433] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.261Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1116gitlab # [ 182.540189] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.264Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1117gitlab # [ 182.542785] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.266Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1118gitlab # [ 182.545365] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.269Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1119gitlab # [ 182.547772] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.273Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1120gitlab # [ 182.550339] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.275Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1121gitlab # [ 182.552738] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.278Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1122gitlab # [ 182.554989] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.281Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1123gitlab # [ 182.563078] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.290Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1124gitlab # [ 182.566496] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.294Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1125gitlab # [ 182.569496] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.297Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1126gitlab # [ 182.572581] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.300Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1127gitlab # [ 182.575362] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.303Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1128gitlab # [ 182.578440] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.306Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1129gitlab # [ 182.580946] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.308Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1130gitlab # [ 182.583393] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.311Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1131gitlab # [ 182.585820] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.313Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1132gitlab # [ 182.588079] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.315Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1133gitlab # [ 182.673006] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.400Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1134gitlab # [ 182.677189] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.404Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1135gitlab # [ 182.681477] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.407Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1136gitlab # [ 182.685659] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.411Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1137gitlab # [ 182.689642] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.413Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1138gitlab # [ 182.693779] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.417Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1139gitlab # [ 182.698174] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.419Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1140gitlab # [ 182.702596] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.422Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1141gitlab # [ 182.706922] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.424Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1142gitlab # [ 182.711176] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.427Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1143gitlab # [ 182.715190] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.430Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1144gitlab # [ 182.719232] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.432Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1145gitlab # [ 182.723002] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.435Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1146gitlab # [ 182.726659] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.437Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1147gitlab # [ 182.729973] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.440Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1148gitlab # [ 182.734621] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.442Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1149gitlab # [ 182.737725] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.445Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1150gitlab # [ 182.740753] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.447Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1151gitlab # [ 182.743980] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.451Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1152gitlab # [ 182.747493] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.454Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1153gitlab # [ 182.750852] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.458Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1154gitlab # [ 182.754041] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.461Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1155gitlab # [ 182.757335] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.465Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1156gitlab # [ 182.760451] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.467Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1157gitlab # [ 182.763580] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.471Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1158gitlab # [ 182.766772] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.473Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1159gitlab # [ 182.769790] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.476Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1160gitlab # [ 182.772594] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.478Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1161gitlab # [ 182.775353] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.480Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1162gitlab # [ 182.778147] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.483Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1163gitlab # [ 182.780766] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.484Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1164gitlab # [ 182.783435] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.487Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1165gitlab # [ 182.785764] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.490Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1166gitlab # [ 182.788311] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.493Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1167gitlab # [ 182.790720] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.495Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1168gitlab # [ 182.793140] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.498Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1169gitlab # [ 182.795409] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.510Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1170gitlab # [ 182.797787] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.513Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1171gitlab # [ 182.799978] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.515Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1172gitlab # [ 182.802395] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.520Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1173gitlab # [ 182.804409] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.523Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1174gitlab # [ 182.806559] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.526Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1175gitlab # [ 182.808896] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.529Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1176gitlab # [ 182.811169] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.532Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1177gitlab # [ 182.813353] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.534Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1178gitlab # [ 182.815571] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.538Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1179gitlab # [ 182.817894] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:29:43.541Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1180gitlab # [ 190.038452] gitlab-workhorse[817]: time="2026-09-01T10:29:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1181gitlab # [ 200.046481] gitlab-workhorse[817]: time="2026-09-01T10:30:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 210.047729] gitlab-workhorse[817]: time="2026-09-01T10:30:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 220.058854] gitlab-workhorse[817]: time="2026-09-01T10:30:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 226.340186] postgres[2833]: [2833] ERROR: relation "table_without_models" does not exist1185gitlab # [ 226.340637] postgres[2833]: [2833] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1186gitlab # [ 230.066447] gitlab-workhorse[817]: time="2026-09-01T10:30:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 231.839657] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:32.565Z","message":"Booted Rails 7.2.3.1 application in production environment"}1188gitlab # [ 231.840679] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:32.568Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1189gitlab # [ 231.847770] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:32.573Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1190gitlab # [ 231.849613] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:32.574Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1191gitlab # [ 231.851526] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:32.578Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1192gitlab # [ 232.498040] postgres[2885]: [2885] ERROR: relation "table_without_models" does not exist1193gitlab # [ 232.498448] postgres[2885]: [2885] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1194gitlab # [ 234.878452] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:35.604Z","message":"Cleaning working queues"}1195gitlab # [ 234.881978] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:35.607Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"0b460464fe25a7ca5d7472fc","created_at":"2026-09-01T10:28:49.400Z","trace_propagation_headers":{"sentry-trace":"2aef0021e10e43b4b68fce873145c4f5-a03f052b78304007","baggage":"sentry-trace_id=2aef0021e10e43b4b68fce873145c4f5,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"f8cc3898222ef4e465c2114fc9488fd1","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:28:49.413Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-0b460464fe25a7ca5d7472fc: start","job_status":"start","queue_duration_s":106.193419,"scheduling_latency_s":106.193485}1196gitlab # [ 235.185747] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:35.912Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"0b460464fe25a7ca5d7472fc","created_at":"2026-09-01T10:28:49.400Z","trace_propagation_headers":{"sentry-trace":"2aef0021e10e43b4b68fce873145c4f5-a03f052b78304007","baggage":"sentry-trace_id=2aef0021e10e43b4b68fce873145c4f5,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"f8cc3898222ef4e465c2114fc9488fd1","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:28:49.413Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-0b460464fe25a7ca5d7472fc: done: 0.305729 sec","job_status":"done","queue_duration_s":106.193419,"scheduling_latency_s":106.193485,"redis_calls":29,"redis_duration_s":0.011339,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.006691,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002793,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.14492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1673008,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.305729,"completed_at":"2026-09-01T10:30:35.912Z","load_balancing_strategy":"primary","db_duration_s":0.107738,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1197gitlab # [ 238.760667] bundle[2017]: {"timestamp":"2026-09-01T10:30:39.487Z","pid":2017,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1198gitlab # [ 238.761015] bundle[2017]: {"timestamp":"2026-09-01T10:30:39.487Z","pid":2017,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1199gitlab # [ 238.761219] bundle[2017]: {"timestamp":"2026-09-01T10:30:39.487Z","pid":2017,"message":"! #\u003cThread:0x0000e7c5d02c6590 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1200gitlab # [ 238.761425] bundle[2017]: {"timestamp":"2026-09-01T10:30:39.487Z","pid":2017,"message":"! #\u003cThread:0x0000e7c5cdb52720 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1201gitlab # [ 238.761545] bundle[2017]: {"timestamp":"2026-09-01T10:30:39.487Z","pid":2017,"message":"Use Ctrl-C to stop"}1202gitlab # [ 238.761653] bundle[2017]: {"timestamp":"2026-09-01T10:30:39.488Z","pid":2017,"message":"Sending status to systemd every 1.0 sec"}1203gitlab # [ 239.464427] bundle[2017]: {"timestamp":"2026-09-01T10:30:40.191Z","pid":2017,"message":"- Worker 0 (PID: 2999) booted in 0.66s, phase: 0"}1204gitlab # [ 239.497158] bundle[2017]: {"timestamp":"2026-09-01T10:30:40.224Z","pid":2017,"message":"- Worker 1 (PID: 3003) booted in 0.67s, phase: 0"}1205gitlab # [ 239.501880] systemd[1]: Started gitlab.service.1206gitlab # [ 239.502718] systemd[1]: Reached target Common target for all GitLab services..1207gitlab # [ 239.508470] systemd[1]: Starting setup-gitlab.service...1208gitlab # [ 239.543341] setup-gitlab-start[3036]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1209gitlab # [ 243.466066] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:30:44 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 38721210gitlab # [ 243.472689] setup-gitlab-start[3036]: + TOKEN=nixbot-test-token-of-20-chars1211gitlab # [ 243.475698] setup-gitlab-start[3036]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1212gitlab # [ 243.491999] runuser[3066]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1213gitlab # [ 244.100002] setup-gitlab-start[3067]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1214gitlab # [ 244.100468] setup-gitlab-start[3067]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1215gitlab # [ 244.102522] setup-gitlab-start[3067]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1216gitlab # [ 245.074816] setup-gitlab-start[3067]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 245.075225] setup-gitlab-start[3067]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 245.078328] setup-gitlab-start[3067]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 249.819098] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:50.545Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4061870a60498f9081d1f3bd","created_at":"2026-09-01T10:30:50.431Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5bc0192bfb48ef158778e63afbd8d6f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.541Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4061870a60498f9081d1f3bd: start","job_status":"start","queue_duration_s":0.003716,"scheduling_latency_s":0.003783}1220gitlab # [ 250.033024] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:50.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4061870a60498f9081d1f3bd","created_at":"2026-09-01T10:30:50.431Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5bc0192bfb48ef158778e63afbd8d6f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.541Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4061870a60498f9081d1f3bd: done: 0.214361 sec","job_status":"done","queue_duration_s":0.003716,"scheduling_latency_s":0.003783,"redis_calls":12,"redis_duration_s":0.03368,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.011413,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004197,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00706432,"duration_s":0.214361,"completed_at":"2026-09-01T10:30:50.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056002,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1221gitlab # [ 250.127427] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:50.767Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"6d166a57705fbfffbb5e4821","created_at":"2026-09-01T10:30:50.560Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"163c1dc3b146e406b9f0c6949e5120d3","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.594Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-6d166a57705fbfffbb5e4821: start","job_status":"start","queue_duration_s":0.172767,"scheduling_latency_s":0.172834}1222gitlab # [ 250.145043] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:50.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"6d166a57705fbfffbb5e4821","created_at":"2026-09-01T10:30:50.560Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"163c1dc3b146e406b9f0c6949e5120d3","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.594Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-6d166a57705fbfffbb5e4821: done: 0.100098 sec","job_status":"done","queue_duration_s":0.172767,"scheduling_latency_s":0.172834,"redis_calls":11,"redis_duration_s":0.004853,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00095,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001433,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007477,"duration_s":0.100098,"completed_at":"2026-09-01T10:30:50.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1223gitlab # [ 250.188113] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:50.872Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"bb83a82203763dd734244709","created_at":"2026-09-01T10:30:50.623Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43e81303f0d12cd25c66a801eab558b1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.639Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-bb83a82203763dd734244709: start","job_status":"start","queue_duration_s":0.233015,"scheduling_latency_s":0.233122}1224gitlab # [ 252.261119] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:52.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"bb83a82203763dd734244709","created_at":"2026-09-01T10:30:50.623Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43e81303f0d12cd25c66a801eab558b1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.639Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-bb83a82203763dd734244709: done: 2.115266 sec","job_status":"done","queue_duration_s":0.233015,"scheduling_latency_s":0.233122,"redis_calls":565,"redis_duration_s":1.250374,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.246337,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.986027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045122,"duration_s":2.115266,"completed_at":"2026-09-01T10:30:52.987Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002445,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1225gitlab # [ 252.262772] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:52.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"836adbaf2c725852d7278639","created_at":"2026-09-01T10:30:50.653Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"492dc77af8950172a2ffcd78204754c6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.663Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-836adbaf2c725852d7278639: start","job_status":"start","queue_duration_s":2.326097,"scheduling_latency_s":2.326135}1226gitlab # [ 252.372631] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"836adbaf2c725852d7278639","created_at":"2026-09-01T10:30:50.653Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"492dc77af8950172a2ffcd78204754c6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.663Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-836adbaf2c725852d7278639: done: 0.039013 sec","job_status":"done","queue_duration_s":2.326097,"scheduling_latency_s":2.326135,"redis_calls":10,"redis_duration_s":0.0027660000000000002,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000622,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001556,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045246,"duration_s":0.039013,"completed_at":"2026-09-01T10:30:53.028Z","load_balancing_strategy":"primary","db_duration_s":0.000693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 252.425610] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"76d1b690640517ef7c28f64e","created_at":"2026-09-01T10:30:50.677Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ea330065c134e8139cd1883812f1a24","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.689Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-76d1b690640517ef7c28f64e: start","job_status":"start","queue_duration_s":2.341619,"scheduling_latency_s":2.341652}1228gitlab # [ 252.440666] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"76d1b690640517ef7c28f64e","created_at":"2026-09-01T10:30:50.677Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ea330065c134e8139cd1883812f1a24","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.689Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-76d1b690640517ef7c28f64e: done: 0.047379 sec","job_status":"done","queue_duration_s":2.341619,"scheduling_latency_s":2.341652,"redis_calls":10,"redis_duration_s":0.002997,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000972,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003726,"duration_s":0.047379,"completed_at":"2026-09-01T10:30:53.078Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 252.482352] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.080Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"f906a15388e68f61fe065df6","created_at":"2026-09-01T10:30:50.718Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5c064067a988d1a103718accb008682","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.748Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-f906a15388e68f61fe065df6: start","job_status":"start","queue_duration_s":2.331693,"scheduling_latency_s":2.331729}1230gitlab # [ 252.496617] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.113Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"f906a15388e68f61fe065df6","created_at":"2026-09-01T10:30:50.718Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5c064067a988d1a103718accb008682","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.748Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-f906a15388e68f61fe065df6: done: 0.033595 sec","job_status":"done","queue_duration_s":2.331693,"scheduling_latency_s":2.331729,"redis_calls":12,"redis_duration_s":0.002479,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006039,"exclusive_lock_hold_duration_s":0.00454322,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.033595,"completed_at":"2026-09-01T10:30:53.113Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 252.539523] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7671e11e29c9f886f3174924","created_at":"2026-09-01T10:30:50.769Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33c8142c0e4db1419e715f29c18e58ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.829Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7671e11e29c9f886f3174924: start","job_status":"start","queue_duration_s":2.285698,"scheduling_latency_s":2.28572}1232gitlab # [ 252.555336] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7671e11e29c9f886f3174924","created_at":"2026-09-01T10:30:50.769Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33c8142c0e4db1419e715f29c18e58ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.829Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7671e11e29c9f886f3174924: done: 0.022553 sec","job_status":"done","queue_duration_s":2.285698,"scheduling_latency_s":2.28572,"redis_calls":10,"redis_duration_s":0.001539,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000324,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031752,"duration_s":0.022553,"completed_at":"2026-09-01T10:30:53.137Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 252.597042] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"16c2503fe2cd32a54446bdf5","created_at":"2026-09-01T10:30:50.880Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7def06a56459560f22f37cc7b86e890f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.896Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-16c2503fe2cd32a54446bdf5: start","job_status":"start","queue_duration_s":2.243031,"scheduling_latency_s":2.243053}1234gitlab # [ 252.611220] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.174Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"16c2503fe2cd32a54446bdf5","created_at":"2026-09-01T10:30:50.880Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7def06a56459560f22f37cc7b86e890f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.896Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-16c2503fe2cd32a54446bdf5: done: 0.03551 sec","job_status":"done","queue_duration_s":2.243031,"scheduling_latency_s":2.243053,"redis_calls":17,"redis_duration_s":0.0033439999999999998,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001412,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000325,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067044,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.03551,"completed_at":"2026-09-01T10:30:53.174Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 252.654206] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"567ac5c76f5e8804fd1fcd1e","created_at":"2026-09-01T10:30:50.951Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90c94176c16a5c54e3985b9c2eea0501","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.982Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-567ac5c76f5e8804fd1fcd1e: start","job_status":"start","queue_duration_s":2.19392,"scheduling_latency_s":2.193946}1236gitlab # [ 252.668338] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"567ac5c76f5e8804fd1fcd1e","created_at":"2026-09-01T10:30:50.951Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90c94176c16a5c54e3985b9c2eea0501","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:50.982Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-567ac5c76f5e8804fd1fcd1e: done: 0.093887 sec","job_status":"done","queue_duration_s":2.19392,"scheduling_latency_s":2.193946,"redis_calls":14,"redis_duration_s":0.00267,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000721,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056022,"exclusive_lock_hold_duration_s":0.0654265,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.093887,"completed_at":"2026-09-01T10:30:53.270Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 252.712122] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e047f540480eb3ced9f4515e","created_at":"2026-09-01T10:30:51.025Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7208165e1c4cae334b96e6052bbe27b4","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.054Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e047f540480eb3ced9f4515e: start","job_status":"start","queue_duration_s":2.218639,"scheduling_latency_s":2.218667}1238gitlab # [ 252.726205] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e047f540480eb3ced9f4515e","created_at":"2026-09-01T10:30:51.025Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7208165e1c4cae334b96e6052bbe27b4","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.054Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e047f540480eb3ced9f4515e: done: 0.039792 sec","job_status":"done","queue_duration_s":2.218639,"scheduling_latency_s":2.218667,"redis_calls":13,"redis_duration_s":0.002594,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001309,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000875,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01174282,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.039792,"completed_at":"2026-09-01T10:30:53.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003388,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1239gitlab # [ 252.771182] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"b348c36d96984ee053b8ff53","created_at":"2026-09-01T10:30:51.076Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.100Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-b348c36d96984ee053b8ff53: start","job_status":"start","queue_duration_s":2.214081,"scheduling_latency_s":2.214107}1240gitlab # [ 252.785543] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"b348c36d96984ee053b8ff53","created_at":"2026-09-01T10:30:51.076Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.100Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-b348c36d96984ee053b8ff53: done: 0.050102 sec","job_status":"done","queue_duration_s":2.214081,"scheduling_latency_s":2.214107,"redis_calls":24,"redis_duration_s":0.005055,"redis_read_bytes":25,"redis_write_bytes":5972,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00085,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":704,"redis_queues_calls":2,"redis_queues_duration_s":0.000436,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3805,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.00266,"redis_queues_metadata_read_bytes":14,"redis_queues_metadata_write_bytes":894,"redis_shared_state_calls":7,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":569,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046114,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.max_buckets":5,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.available_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.occupied_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.stale_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.missing_count":5,"duration_s":0.050102,"completed_at":"2026-09-01T10:30:53.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001149,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 252.832219] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"193f7d747e6e994d0f5c5eb5","created_at":"2026-09-01T10:30:51.150Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8217f2d8a15153d1c19a54b4cd134cbf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:30:51.178Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-193f7d747e6e994d0f5c5eb5: start","job_status":"start","queue_duration_s":2.188057,"scheduling_latency_s":2.188095}1242gitlab # [ 252.845228] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.387Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1243gitlab # [ 252.848458] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.400Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"193f7d747e6e994d0f5c5eb5","created_at":"2026-09-01T10:30:51.150Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8217f2d8a15153d1c19a54b4cd134cbf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:30:51.178Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-193f7d747e6e994d0f5c5eb5: done: 0.033956 sec","job_status":"done","queue_duration_s":2.188057,"scheduling_latency_s":2.188095,"redis_calls":10,"redis_duration_s":0.002829,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000613,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000684,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065914,"duration_s":0.033956,"completed_at":"2026-09-01T10:30:53.400Z","load_balancing_strategy":"primary","db_duration_s":0.00068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 252.888432] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"239a2f942950da42c8b10fd3","created_at":"2026-09-01T10:30:51.200Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18f07f02de27d56787cb2abcf41cbf7d","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.229Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-239a2f942950da42c8b10fd3: start","job_status":"start","queue_duration_s":2.173316,"scheduling_latency_s":2.173354}1245gitlab # [ 252.902544] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"239a2f942950da42c8b10fd3","created_at":"2026-09-01T10:30:51.200Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18f07f02de27d56787cb2abcf41cbf7d","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.229Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-239a2f942950da42c8b10fd3: done: 0.034527 sec","job_status":"done","queue_duration_s":2.173316,"scheduling_latency_s":2.173354,"redis_calls":13,"redis_duration_s":0.0024909999999999997,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001058,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049588,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.034527,"completed_at":"2026-09-01T10:30:53.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 252.945652] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9504744ed737122a9511f5f1","created_at":"2026-09-01T10:30:51.278Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3f261a4ce000bff766a396eb4f32e03","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.317Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9504744ed737122a9511f5f1: start","job_status":"start","queue_duration_s":2.12203,"scheduling_latency_s":2.12206}1247gitlab # [ 252.959180] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9504744ed737122a9511f5f1","created_at":"2026-09-01T10:30:51.278Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3f261a4ce000bff766a396eb4f32e03","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.317Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9504744ed737122a9511f5f1: done: 0.051592 sec","job_status":"done","queue_duration_s":2.12203,"scheduling_latency_s":2.12206,"redis_calls":10,"redis_duration_s":0.001918,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000583,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000342,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030712,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.051592,"completed_at":"2026-09-01T10:30:53.490Z","load_balancing_strategy":"primary","db_duration_s":0.023891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 253.002485] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"89ba36d49eea0a628994ac6d","created_at":"2026-09-01T10:30:51.374Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2778fe71c486fcc3d47f9acae15e6b93","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.400Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-89ba36d49eea0a628994ac6d: start","job_status":"start","queue_duration_s":2.092422,"scheduling_latency_s":2.092456}1249gitlab # [ 253.016191] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.526Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"89ba36d49eea0a628994ac6d","created_at":"2026-09-01T10:30:51.374Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2778fe71c486fcc3d47f9acae15e6b93","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.400Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-89ba36d49eea0a628994ac6d: done: 0.033635 sec","job_status":"done","queue_duration_s":2.092422,"scheduling_latency_s":2.092456,"redis_calls":10,"redis_duration_s":0.001967,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000367,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035386,"duration_s":0.033635,"completed_at":"2026-09-01T10:30:53.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005873,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 253.056616] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"18817dbdb663bf9d88343324","created_at":"2026-09-01T10:30:51.427Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38f28e2afa59055ea2995e2eed27aff6","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.450Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-18817dbdb663bf9d88343324: start","job_status":"start","queue_duration_s":2.076596,"scheduling_latency_s":2.076619}1251gitlab # [ 253.069588] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"18817dbdb663bf9d88343324","created_at":"2026-09-01T10:30:51.427Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38f28e2afa59055ea2995e2eed27aff6","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.450Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-18817dbdb663bf9d88343324: done: 0.035709 sec","job_status":"done","queue_duration_s":2.076596,"scheduling_latency_s":2.076619,"redis_calls":10,"redis_duration_s":0.001687,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000348,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000341,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031176,"duration_s":0.035709,"completed_at":"2026-09-01T10:30:53.563Z","load_balancing_strategy":"primary","db_duration_s":0.007887,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 253.109555] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.565Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"d4a0315570e84932ace768e8","created_at":"2026-09-01T10:30:51.485Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.509Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-d4a0315570e84932ace768e8: start","job_status":"start","queue_duration_s":2.055793,"scheduling_latency_s":2.055826}1253gitlab # [ 253.122606] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"d4a0315570e84932ace768e8","created_at":"2026-09-01T10:30:51.485Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.509Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-d4a0315570e84932ace768e8: done: 0.146384 sec","job_status":"done","queue_duration_s":2.055793,"scheduling_latency_s":2.055826,"redis_calls":71,"redis_duration_s":0.017199000000000002,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001894,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001244,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013284,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043576,"duration_s":0.146384,"completed_at":"2026-09-01T10:30:53.711Z","load_balancing_strategy":"primary","db_duration_s":0.003526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 253.164177] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ef05054f1abc9be801e9f5d0","created_at":"2026-09-01T10:30:51.531Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"903bdc8a25586b0cce7613676f5087fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.559Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ef05054f1abc9be801e9f5d0: start","job_status":"start","queue_duration_s":2.154455,"scheduling_latency_s":2.154484}1255gitlab # [ 253.179907] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.729Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1256gitlab # [ 253.183794] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.739Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ef05054f1abc9be801e9f5d0","created_at":"2026-09-01T10:30:51.531Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"903bdc8a25586b0cce7613676f5087fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.559Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ef05054f1abc9be801e9f5d0: done: 0.025374 sec","job_status":"done","queue_duration_s":2.154455,"scheduling_latency_s":2.154484,"redis_calls":10,"redis_duration_s":0.0028640000000000002,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000598,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000639,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039186,"duration_s":0.025374,"completed_at":"2026-09-01T10:30:53.739Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000969,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 253.225124] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"6e0aa9dfda2622ef2f1468eb","created_at":"2026-09-01T10:30:51.584Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"baae43f8ffd19b9f9e62514fd2d2f73d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.610Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-6e0aa9dfda2622ef2f1468eb: start","job_status":"start","queue_duration_s":2.130294,"scheduling_latency_s":2.130324}1258gitlab # [ 253.239009] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.788Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"6e0aa9dfda2622ef2f1468eb","created_at":"2026-09-01T10:30:51.584Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"baae43f8ffd19b9f9e62514fd2d2f73d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.610Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-6e0aa9dfda2622ef2f1468eb: done: 0.047468 sec","job_status":"done","queue_duration_s":2.130294,"scheduling_latency_s":2.130324,"redis_calls":20,"redis_duration_s":0.006305000000000001,"redis_read_bytes":23,"redis_write_bytes":4316,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002442,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000942,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2021,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002259,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041528,"duration_s":0.047468,"completed_at":"2026-09-01T10:30:53.788Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259gitlab # [ 253.281476] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.790Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1fc7b13a7729fd692442b84d","created_at":"2026-09-01T10:30:51.633Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1159953ca884b16ff73a4790886a8564","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:30:51.655Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1fc7b13a7729fd692442b84d: start","job_status":"start","queue_duration_s":2.134593,"scheduling_latency_s":2.134619}1260gitlab # [ 253.294199] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.957Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1fc7b13a7729fd692442b84d","created_at":"2026-09-01T10:30:51.633Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1159953ca884b16ff73a4790886a8564","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:30:51.655Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1fc7b13a7729fd692442b84d: done: 0.167448 sec","job_status":"done","queue_duration_s":2.134593,"scheduling_latency_s":2.134619,"redis_calls":10,"redis_duration_s":0.003006,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.148865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049108,"duration_s":0.167448,"completed_at":"2026-09-01T10:30:53.957Z","load_balancing_strategy":"primary","db_duration_s":0.009122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1261gitlab # [ 253.333661] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::ImportFileCleanupWorker","jid":"6dd66f933071d6db2fb3f0d7","created_at":"2026-09-01T10:30:51.691Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2445d6dcdbf27ba654035348648a2085","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:872203d04eabf30611038084c617b8ff07fd3e5607b1d8e2c977d615a3cfd3cb","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.714Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::ImportFileCleanupWorker JID-6dd66f933071d6db2fb3f0d7: start","job_status":"start","queue_duration_s":2.245334,"scheduling_latency_s":2.245358}1262gitlab # [ 253.347476] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::ImportFileCleanupWorker","jid":"6dd66f933071d6db2fb3f0d7","created_at":"2026-09-01T10:30:51.691Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2445d6dcdbf27ba654035348648a2085","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:872203d04eabf30611038084c617b8ff07fd3e5607b1d8e2c977d615a3cfd3cb","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.714Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::ImportFileCleanupWorker JID-6dd66f933071d6db2fb3f0d7: done: 0.033402 sec","job_status":"done","queue_duration_s":2.245334,"scheduling_latency_s":2.245358,"redis_calls":10,"redis_duration_s":0.0030889999999999997,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000699,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000624,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004817,"duration_s":0.033402,"completed_at":"2026-09-01T10:30:53.992Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 253.389850] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:53.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"bfd403ffa51345435ed75071","created_at":"2026-09-01T10:30:51.746Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33e9c67591bba27f9965bb9e8a658df5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.771Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-bfd403ffa51345435ed75071: start","job_status":"start","queue_duration_s":2.223812,"scheduling_latency_s":2.223834}1264gitlab # [ 253.565025] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.292Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"bfd403ffa51345435ed75071","created_at":"2026-09-01T10:30:51.746Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33e9c67591bba27f9965bb9e8a658df5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.771Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-bfd403ffa51345435ed75071: done: 0.297209 sec","job_status":"done","queue_duration_s":2.223812,"scheduling_latency_s":2.223834,"redis_calls":14,"redis_duration_s":0.004384,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001303,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001586,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001495,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.06,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.216594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007056,"exclusive_lock_hold_duration_s":0.26913472,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.297209,"completed_at":"2026-09-01T10:30:54.292Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.090268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 253.661033] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.294Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"80867ef5bbbdeac0909b739a","created_at":"2026-09-01T10:30:51.791Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8450c1ce7be6f9b9305199105c5c07d1","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.814Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-80867ef5bbbdeac0909b739a: start","job_status":"start","queue_duration_s":2.479499,"scheduling_latency_s":2.479523}1266gitlab # [ 253.701814] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.326Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"80867ef5bbbdeac0909b739a","created_at":"2026-09-01T10:30:51.791Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8450c1ce7be6f9b9305199105c5c07d1","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.814Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-80867ef5bbbdeac0909b739a: done: 0.032209 sec","job_status":"done","queue_duration_s":2.479499,"scheduling_latency_s":2.479523,"redis_calls":10,"redis_duration_s":0.003102,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000734,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004086,"duration_s":0.032209,"completed_at":"2026-09-01T10:30:54.326Z","load_balancing_strategy":"primary","db_duration_s":0.000933,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 253.774737] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"611e979cb819e7fc811a058f","created_at":"2026-09-01T10:30:51.841Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41c5b2094b4b7de7e03923dd334459e9","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.863Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-611e979cb819e7fc811a058f: start","job_status":"start","queue_duration_s":2.464488,"scheduling_latency_s":2.464512}1268gitlab # [ 253.793717] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.371Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"611e979cb819e7fc811a058f","created_at":"2026-09-01T10:30:51.841Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41c5b2094b4b7de7e03923dd334459e9","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.863Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-611e979cb819e7fc811a058f: done: 0.043264 sec","job_status":"done","queue_duration_s":2.464488,"scheduling_latency_s":2.464512,"redis_calls":10,"redis_duration_s":0.003193,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000614,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055418,"duration_s":0.043264,"completed_at":"2026-09-01T10:30:54.371Z","load_balancing_strategy":"primary","db_duration_s":0.009089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 253.841829] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.373Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9fca7dc0e3fe7673a4d83e51","created_at":"2026-09-01T10:30:51.888Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3e2a02671592927c664d2c4ab4f2922","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.911Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9fca7dc0e3fe7673a4d83e51: start","job_status":"start","queue_duration_s":2.462111,"scheduling_latency_s":2.462136}1270gitlab # [ 253.856161] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.413Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9fca7dc0e3fe7673a4d83e51","created_at":"2026-09-01T10:30:51.888Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3e2a02671592927c664d2c4ab4f2922","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.911Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9fca7dc0e3fe7673a4d83e51: done: 0.040145 sec","job_status":"done","queue_duration_s":2.462111,"scheduling_latency_s":2.462136,"redis_calls":10,"redis_duration_s":0.002448,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000539,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031402,"duration_s":0.040145,"completed_at":"2026-09-01T10:30:54.413Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 253.897891] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d0202d77910014d206821aec","created_at":"2026-09-01T10:30:51.937Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58a15b196b0be2b3d49da1ffe3aa96c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.960Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d0202d77910014d206821aec: start","job_status":"start","queue_duration_s":2.45456,"scheduling_latency_s":2.45459}1272gitlab # [ 253.911444] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.455Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d0202d77910014d206821aec","created_at":"2026-09-01T10:30:51.937Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58a15b196b0be2b3d49da1ffe3aa96c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:51.960Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d0202d77910014d206821aec: done: 0.039895 sec","job_status":"done","queue_duration_s":2.45456,"scheduling_latency_s":2.45459,"redis_calls":12,"redis_duration_s":0.0020670000000000003,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005856,"exclusive_lock_hold_duration_s":0.013136160000000001,"duration_s":0.039895,"completed_at":"2026-09-01T10:30:54.455Z","load_balancing_strategy":"primary","db_duration_s":0.008618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 253.953025] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.456Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"ecac9b6d76eade91297f5d10","created_at":"2026-09-01T10:30:51.986Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34568790760388a8859588d26f316298","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.009Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-ecac9b6d76eade91297f5d10: start","job_status":"start","queue_duration_s":2.44722,"scheduling_latency_s":2.447248}1274gitlab # [ 253.966341] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"ecac9b6d76eade91297f5d10","created_at":"2026-09-01T10:30:51.986Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34568790760388a8859588d26f316298","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.009Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-ecac9b6d76eade91297f5d10: done: 0.034634 sec","job_status":"done","queue_duration_s":2.44722,"scheduling_latency_s":2.447248,"redis_calls":10,"redis_duration_s":0.001735,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000363,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000365,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029932,"duration_s":0.034634,"completed_at":"2026-09-01T10:30:54.491Z","load_balancing_strategy":"primary","db_duration_s":0.00514,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 254.007040] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b023bc3c0fc6a156af403335","created_at":"2026-09-01T10:30:52.041Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b8c71cc892a2de30ad4bb72d8894962","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.072Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b023bc3c0fc6a156af403335: start","job_status":"start","queue_duration_s":2.420251,"scheduling_latency_s":2.420276}1276gitlab # [ 254.022960] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b023bc3c0fc6a156af403335","created_at":"2026-09-01T10:30:52.041Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b8c71cc892a2de30ad4bb72d8894962","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.072Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b023bc3c0fc6a156af403335: done: 0.050306 sec","job_status":"done","queue_duration_s":2.420251,"scheduling_latency_s":2.420276,"redis_calls":12,"redis_duration_s":0.002509,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000397,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001076,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00081524,"exclusive_lock_hold_duration_s":0.015547440000000001,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.050306,"completed_at":"2026-09-01T10:30:54.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 254.067096] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"76ee6b1eaf8134700d08c250","created_at":"2026-09-01T10:30:52.107Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1ae7b92808ea440b9300eccfc7560f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.140Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-76ee6b1eaf8134700d08c250: start","job_status":"start","queue_duration_s":2.404333,"scheduling_latency_s":2.404359}1278gitlab # [ 254.081495] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.559Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1279gitlab # [ 254.085021] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.567Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"76ee6b1eaf8134700d08c250","created_at":"2026-09-01T10:30:52.107Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1ae7b92808ea440b9300eccfc7560f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.140Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-76ee6b1eaf8134700d08c250: done: 0.022654 sec","job_status":"done","queue_duration_s":2.404333,"scheduling_latency_s":2.404359,"redis_calls":10,"redis_duration_s":0.001669,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000381,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000357,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028296,"duration_s":0.022654,"completed_at":"2026-09-01T10:30:54.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 254.127027] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckExportJobsWorker","jid":"30393090c617e1cf7921a7ca","created_at":"2026-09-01T10:30:52.165Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d7f2005e71daf13f40ecbd14a02e315","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c05136a1912f23c3950f9f6243170d655fcc26d1e5b96896d7e248d72f9039fe","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.191Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckExportJobsWorker JID-30393090c617e1cf7921a7ca: start","job_status":"start","queue_duration_s":2.377864,"scheduling_latency_s":2.377887}1281gitlab # [ 254.140104] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.602Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckExportJobsWorker","jid":"30393090c617e1cf7921a7ca","created_at":"2026-09-01T10:30:52.165Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d7f2005e71daf13f40ecbd14a02e315","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c05136a1912f23c3950f9f6243170d655fcc26d1e5b96896d7e248d72f9039fe","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.191Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckExportJobsWorker JID-30393090c617e1cf7921a7ca: done: 0.033822 sec","job_status":"done","queue_duration_s":2.377864,"scheduling_latency_s":2.377887,"redis_calls":10,"redis_duration_s":0.002094,"redis_read_bytes":9,"redis_write_bytes":995,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000421,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":192,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031772,"duration_s":0.033822,"completed_at":"2026-09-01T10:30:54.602Z","load_balancing_strategy":"primary","db_duration_s":0.00409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 254.180774] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Export::PruneProjectExportJobsWorker","jid":"24d476477c32ae757f096c63","created_at":"2026-09-01T10:30:52.237Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a0cdedc186a4ba6c9843ee8c73cec00","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b2f7045536fe38235224f4d98e515e25b0b0eea1aa1ae4b4ab9f99ab22c53b43","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.262Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Export::PruneProjectExportJobsWorker JID-24d476477c32ae757f096c63: start","job_status":"start","queue_duration_s":2.342176,"scheduling_latency_s":2.342205}1283gitlab # [ 254.194970] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Export::PruneProjectExportJobsWorker","jid":"24d476477c32ae757f096c63","created_at":"2026-09-01T10:30:52.237Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a0cdedc186a4ba6c9843ee8c73cec00","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b2f7045536fe38235224f4d98e515e25b0b0eea1aa1ae4b4ab9f99ab22c53b43","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.262Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Export::PruneProjectExportJobsWorker JID-24d476477c32ae757f096c63: done: 0.036617 sec","job_status":"done","queue_duration_s":2.342176,"scheduling_latency_s":2.342205,"redis_calls":10,"redis_duration_s":0.0020469999999999998,"redis_read_bytes":9,"redis_write_bytes":1173,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000423,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":236,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032622,"duration_s":0.036617,"completed_at":"2026-09-01T10:30:54.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 254.238054] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"e9f3b20117b4e8d0cc9b1316","created_at":"2026-09-01T10:30:52.288Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4380468d332311ebed00d9b0fda4a907","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.316Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-e9f3b20117b4e8d0cc9b1316: start","job_status":"start","queue_duration_s":2.326261,"scheduling_latency_s":2.326291}1285gitlab # [ 254.251162] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.679Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"e9f3b20117b4e8d0cc9b1316","created_at":"2026-09-01T10:30:52.288Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4380468d332311ebed00d9b0fda4a907","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.316Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-e9f3b20117b4e8d0cc9b1316: done: 0.036147 sec","job_status":"done","queue_duration_s":2.326261,"scheduling_latency_s":2.326291,"redis_calls":11,"redis_duration_s":0.002272,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000484,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033034,"duration_s":0.036147,"completed_at":"2026-09-01T10:30:54.678Z","load_balancing_strategy":"primary","db_duration_s":0.004602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 254.292570] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.680Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c4f2c3267b36c44dd695ffc7","created_at":"2026-09-01T10:30:52.380Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39a65bcb95808a1f67aca78a28eb2d55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.406Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c4f2c3267b36c44dd695ffc7: start","job_status":"start","queue_duration_s":2.274202,"scheduling_latency_s":2.274232}1287gitlab # [ 254.307091] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.695Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1288gitlab # [ 254.310613] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c4f2c3267b36c44dd695ffc7","created_at":"2026-09-01T10:30:52.380Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39a65bcb95808a1f67aca78a28eb2d55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.406Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c4f2c3267b36c44dd695ffc7: done: 0.024019 sec","job_status":"done","queue_duration_s":2.274202,"scheduling_latency_s":2.274232,"redis_calls":10,"redis_duration_s":0.001943,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003098,"duration_s":0.024019,"completed_at":"2026-09-01T10:30:54.704Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 254.352763] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"0b42f49afcf6f959522f752a","created_at":"2026-09-01T10:30:52.430Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f654a1b66f0f54ab534a541a29879a23","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.456Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-0b42f49afcf6f959522f752a: start","job_status":"start","queue_duration_s":2.249456,"scheduling_latency_s":2.249479}1290gitlab # [ 254.367003] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.728Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"0b42f49afcf6f959522f752a","created_at":"2026-09-01T10:30:52.430Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f654a1b66f0f54ab534a541a29879a23","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.456Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-0b42f49afcf6f959522f752a: done: 0.021926 sec","job_status":"done","queue_duration_s":2.249456,"scheduling_latency_s":2.249479,"redis_calls":12,"redis_duration_s":0.001747,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000698,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023782,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.021926,"completed_at":"2026-09-01T10:30:54.728Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 254.411638] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.729Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0b2a92c4ea319f237fa6422f","created_at":"2026-09-01T10:30:52.480Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f163676b4abeecf2af1c181cd2953ed8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.509Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0b2a92c4ea319f237fa6422f: start","job_status":"start","queue_duration_s":2.220156,"scheduling_latency_s":2.220177}1292gitlab # [ 254.427366] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.742Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1293gitlab # [ 254.430742] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0b2a92c4ea319f237fa6422f","created_at":"2026-09-01T10:30:52.480Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f163676b4abeecf2af1c181cd2953ed8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.509Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0b2a92c4ea319f237fa6422f: done: 0.020974 sec","job_status":"done","queue_duration_s":2.220156,"scheduling_latency_s":2.220177,"redis_calls":10,"redis_duration_s":0.001482,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028298,"duration_s":0.020974,"completed_at":"2026-09-01T10:30:54.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000568,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 254.472669] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"fe2cef16b63c1ba5136acfbb","created_at":"2026-09-01T10:30:52.533Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"419469bfe639cec4c1afc6c96b987105","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.559Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-fe2cef16b63c1ba5136acfbb: start","job_status":"start","queue_duration_s":2.192856,"scheduling_latency_s":2.192878}1295gitlab # [ 254.486946] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"fe2cef16b63c1ba5136acfbb","created_at":"2026-09-01T10:30:52.533Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"419469bfe639cec4c1afc6c96b987105","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.559Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-fe2cef16b63c1ba5136acfbb: done: 0.02987 sec","job_status":"done","queue_duration_s":2.192856,"scheduling_latency_s":2.192878,"redis_calls":12,"redis_duration_s":0.002127,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000345,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00069624,"exclusive_lock_hold_duration_s":0.0067366200000000005,"duration_s":0.02987,"completed_at":"2026-09-01T10:30:54.781Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 254.528809] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"d58a6b058f083d623e5d5a02","created_at":"2026-09-01T10:30:52.588Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f342ce05c4b2a9e4b8f3db4155f75cee","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.616Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-d58a6b058f083d623e5d5a02: start","job_status":"start","queue_duration_s":2.166959,"scheduling_latency_s":2.166981}1297gitlab # [ 254.542148] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"d58a6b058f083d623e5d5a02","created_at":"2026-09-01T10:30:52.588Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f342ce05c4b2a9e4b8f3db4155f75cee","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.616Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-d58a6b058f083d623e5d5a02: done: 0.046377 sec","job_status":"done","queue_duration_s":2.166959,"scheduling_latency_s":2.166981,"redis_calls":10,"redis_duration_s":0.0017009999999999998,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000357,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031418,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.00350174},"duration_s":0.046377,"completed_at":"2026-09-01T10:30:54.829Z","load_balancing_strategy":"primary","db_duration_s":0.01235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 254.584442] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.831Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"bdda463069f749417262f219","created_at":"2026-09-01T10:30:52.639Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b64b06fdb369de9167b995106c0206a","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.669Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-bdda463069f749417262f219: start","job_status":"start","queue_duration_s":2.161687,"scheduling_latency_s":2.161709}1299gitlab # [ 254.597251] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.851Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"bdda463069f749417262f219","created_at":"2026-09-01T10:30:52.639Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b64b06fdb369de9167b995106c0206a","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.669Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-bdda463069f749417262f219: done: 0.020904 sec","job_status":"done","queue_duration_s":2.161687,"scheduling_latency_s":2.161709,"redis_calls":12,"redis_duration_s":0.001707,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000377,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025124,"duration_s":0.020904,"completed_at":"2026-09-01T10:30:54.851Z","load_balancing_strategy":"primary","db_duration_s":0.00093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 254.639318] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.853Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e2e0fe64ef9a9f8e378a1bcb","created_at":"2026-09-01T10:30:52.694Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cfd6afc967a5f2503396412d33a032d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:30:52.721Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e2e0fe64ef9a9f8e378a1bcb: start","job_status":"start","queue_duration_s":2.131869,"scheduling_latency_s":2.13189}1301gitlab # [ 254.652888] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.866Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1302gitlab # [ 254.656623] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e2e0fe64ef9a9f8e378a1bcb","created_at":"2026-09-01T10:30:52.694Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cfd6afc967a5f2503396412d33a032d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:30:52.721Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e2e0fe64ef9a9f8e378a1bcb: done: 0.020885 sec","job_status":"done","queue_duration_s":2.131869,"scheduling_latency_s":2.13189,"redis_calls":10,"redis_duration_s":0.001574,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000342,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000326,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002682,"duration_s":0.020885,"completed_at":"2026-09-01T10:30:54.874Z","load_balancing_strategy":"primary","db_duration_s":0.000743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 254.697025] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"7270bca215e0ed71a03f86e3","created_at":"2026-09-01T10:30:52.760Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"219341370213a39ee9b244b093e81cdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.789Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-7270bca215e0ed71a03f86e3: start","job_status":"start","queue_duration_s":2.086344,"scheduling_latency_s":2.086365}1304gitlab # [ 254.710364] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"7270bca215e0ed71a03f86e3","created_at":"2026-09-01T10:30:52.760Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"219341370213a39ee9b244b093e81cdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:52.789Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-7270bca215e0ed71a03f86e3: done: 0.040935 sec","job_status":"done","queue_duration_s":2.086344,"scheduling_latency_s":2.086365,"redis_calls":19,"redis_duration_s":0.003151,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000766,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000291,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00157,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028658,"duration_s":0.040935,"completed_at":"2026-09-01T10:30:54.916Z","load_balancing_strategy":"primary","db_duration_s":0.003737,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 254.752683] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"d654f4da4cb44054c08aefee","created_at":"2026-09-01T10:30:53.330Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-e58275318e4244fe","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-d654f4da4cb44054c08aefee: start","job_status":"start","queue_duration_s":1.565777,"scheduling_latency_s":1.5658}1306gitlab # [ 254.767912] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"d654f4da4cb44054c08aefee","created_at":"2026-09-01T10:30:53.330Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-e58275318e4244fe","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-d654f4da4cb44054c08aefee: done: 0.066921 sec","job_status":"done","queue_duration_s":1.565777,"scheduling_latency_s":1.5658,"redis_calls":18,"redis_duration_s":0.005371,"redis_read_bytes":39,"redis_write_bytes":2116,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000333,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":471,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.003767,"redis_shared_state_read_bytes":34,"redis_shared_state_write_bytes":1324,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006356,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":3,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":3,"duration_s":0.066921,"completed_at":"2026-09-01T10:30:54.985Z","load_balancing_strategy":"primary","db_duration_s":0.011407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 254.811336] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:54.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"c91e10223cfb0783f79c5cdb","created_at":"2026-09-01T10:30:53.330Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-e58275318e4244fe","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-c91e10223cfb0783f79c5cdb: start","job_status":"start","queue_duration_s":1.636984,"scheduling_latency_s":1.637041}1308gitlab # [ 254.824944] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"c91e10223cfb0783f79c5cdb","created_at":"2026-09-01T10:30:53.330Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-e58275318e4244fe","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-c91e10223cfb0783f79c5cdb: done: 0.059848 sec","job_status":"done","queue_duration_s":1.636984,"scheduling_latency_s":1.637041,"redis_calls":15,"redis_duration_s":0.005611,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001806,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.003805,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":4,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":4,"duration_s":0.059848,"completed_at":"2026-09-01T10:30:55.049Z","load_balancing_strategy":"primary","db_duration_s":0.005394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 254.866582] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"fc86d1a60570752cefd77e41","created_at":"2026-09-01T10:30:53.330Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-e58275318e4244fe","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-fc86d1a60570752cefd77e41: start","job_status":"start","queue_duration_s":1.700111,"scheduling_latency_s":1.700159}1310gitlab # [ 254.879159] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"fc86d1a60570752cefd77e41","created_at":"2026-09-01T10:30:53.330Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-e58275318e4244fe","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-fc86d1a60570752cefd77e41: done: 0.048287 sec","job_status":"done","queue_duration_s":1.700111,"scheduling_latency_s":1.700159,"redis_calls":15,"redis_duration_s":0.005608,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002188,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.00342,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":4,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":4,"duration_s":0.048287,"completed_at":"2026-09-01T10:30:55.100Z","load_balancing_strategy":"primary","db_duration_s":0.005437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 254.921084] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"5b69dd2c74ec710da8d4b104","created_at":"2026-09-01T10:30:53.330Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-e58275318e4244fe","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-5b69dd2c74ec710da8d4b104: start","job_status":"start","queue_duration_s":1.751173,"scheduling_latency_s":1.751213}1312gitlab # [ 254.933435] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"5b69dd2c74ec710da8d4b104","created_at":"2026-09-01T10:30:53.330Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-e58275318e4244fe","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-5b69dd2c74ec710da8d4b104: done: 0.044289 sec","job_status":"done","queue_duration_s":1.751173,"scheduling_latency_s":1.751213,"redis_calls":15,"redis_duration_s":0.004826,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001607,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.003219,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":3,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":3,"duration_s":0.044289,"completed_at":"2026-09-01T10:30:55.147Z","load_balancing_strategy":"primary","db_duration_s":0.005306,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 254.975058] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"52284f4a26a9548a1002b5e5","created_at":"2026-09-01T10:30:53.330Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-e58275318e4244fe","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-52284f4a26a9548a1002b5e5: start","job_status":"start","queue_duration_s":1.798118,"scheduling_latency_s":1.798154}1314gitlab # [ 254.987593] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"52284f4a26a9548a1002b5e5","created_at":"2026-09-01T10:30:53.330Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-e58275318e4244fe","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"bc062d7b4e3e522f34e72eca6169d615","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-52284f4a26a9548a1002b5e5: done: 0.041047 sec","job_status":"done","queue_duration_s":1.798118,"scheduling_latency_s":1.798154,"redis_calls":15,"redis_duration_s":0.004564,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00145,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.003114,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":1,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":1,"duration_s":0.041047,"completed_at":"2026-09-01T10:30:55.191Z","load_balancing_strategy":"primary","db_duration_s":0.00551,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 255.030207] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"584c0e47ff2e55572e56ca4f","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-584c0e47ff2e55572e56ca4f: start","job_status":"start","queue_duration_s":1.495707,"scheduling_latency_s":1.495768}1316gitlab # [ 255.042361] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"584c0e47ff2e55572e56ca4f","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-584c0e47ff2e55572e56ca4f: done: 0.069556 sec","job_status":"done","queue_duration_s":1.495707,"scheduling_latency_s":1.495768,"redis_calls":16,"redis_duration_s":0.006487,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000889,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00179,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003808,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006989,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.069556,"completed_at":"2026-09-01T10:30:55.264Z","load_balancing_strategy":"primary","db_duration_s":0.001088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 255.082452] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd3fac18be603050ba736122","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd3fac18be603050ba736122: start","job_status":"start","queue_duration_s":1.568102,"scheduling_latency_s":1.568145}1318gitlab # [ 255.094693] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd3fac18be603050ba736122","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd3fac18be603050ba736122: done: 0.035026 sec","job_status":"done","queue_duration_s":1.568102,"scheduling_latency_s":1.568145,"redis_calls":13,"redis_duration_s":0.0041860000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035026,"completed_at":"2026-09-01T10:30:55.302Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 255.132966] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40ae1073109c85ce9802aec5","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40ae1073109c85ce9802aec5: start","job_status":"start","queue_duration_s":1.606377,"scheduling_latency_s":1.606421}1320gitlab # [ 255.145170] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40ae1073109c85ce9802aec5","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40ae1073109c85ce9802aec5: done: 0.032788 sec","job_status":"done","queue_duration_s":1.606377,"scheduling_latency_s":1.606421,"redis_calls":13,"redis_duration_s":0.003954,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002573,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032788,"completed_at":"2026-09-01T10:30:55.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 255.183552] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d12206c5975c0889521ede65","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d12206c5975c0889521ede65: start","job_status":"start","queue_duration_s":1.641902,"scheduling_latency_s":1.641936}1322gitlab # [ 255.195913] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d12206c5975c0889521ede65","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d12206c5975c0889521ede65: done: 0.03907 sec","job_status":"done","queue_duration_s":1.641902,"scheduling_latency_s":1.641936,"redis_calls":13,"redis_duration_s":0.004799,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03907,"completed_at":"2026-09-01T10:30:55.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 255.235916] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ad775e4c021b808f9924c98","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ad775e4c021b808f9924c98: start","job_status":"start","queue_duration_s":1.685647,"scheduling_latency_s":1.685698}1324gitlab # [ 255.248126] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ad775e4c021b808f9924c98","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ad775e4c021b808f9924c98: done: 0.038272 sec","job_status":"done","queue_duration_s":1.685647,"scheduling_latency_s":1.685698,"redis_calls":13,"redis_duration_s":0.0041,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001413,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002687,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038272,"completed_at":"2026-09-01T10:30:55.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 255.286412] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c4a6c188d5c3811bcc74226","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c4a6c188d5c3811bcc74226: start","job_status":"start","queue_duration_s":1.726948,"scheduling_latency_s":1.726984}1326gitlab # [ 255.299042] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c4a6c188d5c3811bcc74226","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c4a6c188d5c3811bcc74226: done: 0.026777 sec","job_status":"done","queue_duration_s":1.726948,"scheduling_latency_s":1.726984,"redis_calls":13,"redis_duration_s":0.0034850000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002269,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026777,"completed_at":"2026-09-01T10:30:55.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 255.337670] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a07a48561af21a057e0ab12c","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a07a48561af21a057e0ab12c: start","job_status":"start","queue_duration_s":1.756029,"scheduling_latency_s":1.756055}1328gitlab # [ 255.349904] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a07a48561af21a057e0ab12c","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a07a48561af21a057e0ab12c: done: 0.024309 sec","job_status":"done","queue_duration_s":1.756029,"scheduling_latency_s":1.756055,"redis_calls":13,"redis_duration_s":0.004124,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001449,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002675,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024309,"completed_at":"2026-09-01T10:30:55.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 255.388102] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d34d638bb9131c4eb7deb20","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d34d638bb9131c4eb7deb20: start","job_status":"start","queue_duration_s":1.782116,"scheduling_latency_s":1.782141}1330gitlab # [ 255.400095] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d34d638bb9131c4eb7deb20","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d34d638bb9131c4eb7deb20: done: 0.024582 sec","job_status":"done","queue_duration_s":1.782116,"scheduling_latency_s":1.782141,"redis_calls":13,"redis_duration_s":0.003313,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002425,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024582,"completed_at":"2026-09-01T10:30:55.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 255.439835] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23850f48022968b084a124be","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23850f48022968b084a124be: start","job_status":"start","queue_duration_s":1.808301,"scheduling_latency_s":1.808326}1332gitlab # [ 255.452339] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23850f48022968b084a124be","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23850f48022968b084a124be: done: 0.022875 sec","job_status":"done","queue_duration_s":1.808301,"scheduling_latency_s":1.808326,"redis_calls":13,"redis_duration_s":0.002622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022875,"completed_at":"2026-09-01T10:30:55.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 255.491080] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12adc63afb9ac76e40eddc94","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12adc63afb9ac76e40eddc94: start","job_status":"start","queue_duration_s":1.83247,"scheduling_latency_s":1.832491}1334gitlab # [ 255.503534] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12adc63afb9ac76e40eddc94","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12adc63afb9ac76e40eddc94: done: 0.018071 sec","job_status":"done","queue_duration_s":1.83247,"scheduling_latency_s":1.832491,"redis_calls":13,"redis_duration_s":0.002437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001505,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018071,"completed_at":"2026-09-01T10:30:55.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 255.542717] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc12bb821d0ffbba0f27c347","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc12bb821d0ffbba0f27c347: start","job_status":"start","queue_duration_s":1.851872,"scheduling_latency_s":1.851893}1336gitlab # [ 255.555227] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc12bb821d0ffbba0f27c347","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc12bb821d0ffbba0f27c347: done: 0.01963 sec","job_status":"done","queue_duration_s":1.851872,"scheduling_latency_s":1.851893,"redis_calls":13,"redis_duration_s":0.001684,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01963,"completed_at":"2026-09-01T10:30:55.570Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 255.594303] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df6ad9b2eac26815ec121d51","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df6ad9b2eac26815ec121d51: start","job_status":"start","queue_duration_s":1.873015,"scheduling_latency_s":1.873041}1338gitlab # [ 255.606532] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df6ad9b2eac26815ec121d51","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df6ad9b2eac26815ec121d51: done: 0.021694 sec","job_status":"done","queue_duration_s":1.873015,"scheduling_latency_s":1.873041,"redis_calls":13,"redis_duration_s":0.0023810000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001293,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021694,"completed_at":"2026-09-01T10:30:55.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 255.646149] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01ddc56da0274f696bd5032","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01ddc56da0274f696bd5032: start","job_status":"start","queue_duration_s":1.896821,"scheduling_latency_s":1.896852}1340gitlab # [ 255.658349] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01ddc56da0274f696bd5032","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01ddc56da0274f696bd5032: done: 0.033022 sec","job_status":"done","queue_duration_s":1.896821,"scheduling_latency_s":1.896852,"redis_calls":13,"redis_duration_s":0.002234,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001414,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033022,"completed_at":"2026-09-01T10:30:55.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 255.696663] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cf3c2a4a119584b520ec20d","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cf3c2a4a119584b520ec20d: start","job_status":"start","queue_duration_s":1.94307,"scheduling_latency_s":1.943109}1342gitlab # [ 255.708568] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cf3c2a4a119584b520ec20d","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cf3c2a4a119584b520ec20d: done: 0.026127 sec","job_status":"done","queue_duration_s":1.94307,"scheduling_latency_s":1.943109,"redis_calls":13,"redis_duration_s":0.0032459999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001617,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026127,"completed_at":"2026-09-01T10:30:55.668Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 255.747227] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb8ff49b0583b9f6e11b6c80","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb8ff49b0583b9f6e11b6c80: start","job_status":"start","queue_duration_s":1.971916,"scheduling_latency_s":1.971959}1344gitlab # [ 255.759579] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb8ff49b0583b9f6e11b6c80","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb8ff49b0583b9f6e11b6c80: done: 0.028734 sec","job_status":"done","queue_duration_s":1.971916,"scheduling_latency_s":1.971959,"redis_calls":13,"redis_duration_s":0.002771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001807,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028734,"completed_at":"2026-09-01T10:30:55.699Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 255.798235] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e48e4b010b639cdfe0c94e41","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e48e4b010b639cdfe0c94e41: start","job_status":"start","queue_duration_s":2.00364,"scheduling_latency_s":2.00368}1346gitlab # [ 255.814737] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e48e4b010b639cdfe0c94e41","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e48e4b010b639cdfe0c94e41: done: 0.027381 sec","job_status":"done","queue_duration_s":2.00364,"scheduling_latency_s":2.00368,"redis_calls":13,"redis_duration_s":0.003103,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002226,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027381,"completed_at":"2026-09-01T10:30:55.729Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 255.854635] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e98408baabd903d94c8c823","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e98408baabd903d94c8c823: start","job_status":"start","queue_duration_s":2.032915,"scheduling_latency_s":2.03295}1348gitlab # [ 255.866960] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e98408baabd903d94c8c823","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e98408baabd903d94c8c823: done: 0.023506 sec","job_status":"done","queue_duration_s":2.032915,"scheduling_latency_s":2.03295,"redis_calls":13,"redis_duration_s":0.0022459999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000832,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001414,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023506,"completed_at":"2026-09-01T10:30:55.755Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 255.905928] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abdc50eb41202b4bed4853f1","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abdc50eb41202b4bed4853f1: start","job_status":"start","queue_duration_s":2.058412,"scheduling_latency_s":2.058445}1350gitlab # [ 255.918151] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abdc50eb41202b4bed4853f1","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abdc50eb41202b4bed4853f1: done: 0.023919 sec","job_status":"done","queue_duration_s":2.058412,"scheduling_latency_s":2.058445,"redis_calls":13,"redis_duration_s":0.002696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001787,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023919,"completed_at":"2026-09-01T10:30:55.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 255.957054] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05fe4472474f06b411d692e0","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05fe4472474f06b411d692e0: start","job_status":"start","queue_duration_s":2.084208,"scheduling_latency_s":2.08424}1352gitlab # [ 255.969328] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05fe4472474f06b411d692e0","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05fe4472474f06b411d692e0: done: 0.023157 sec","job_status":"done","queue_duration_s":2.084208,"scheduling_latency_s":2.08424,"redis_calls":13,"redis_duration_s":0.002303,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001461,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023157,"completed_at":"2026-09-01T10:30:55.806Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 256.007943] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de592f9d38993f53dac129e4","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de592f9d38993f53dac129e4: start","job_status":"start","queue_duration_s":2.10936,"scheduling_latency_s":2.109393}1354gitlab # [ 256.020479] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de592f9d38993f53dac129e4","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de592f9d38993f53dac129e4: done: 0.02112 sec","job_status":"done","queue_duration_s":2.10936,"scheduling_latency_s":2.109393,"redis_calls":13,"redis_duration_s":0.002104,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02112,"completed_at":"2026-09-01T10:30:55.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 256.060514] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"985b77a3055bb7df057f2a2a","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-985b77a3055bb7df057f2a2a: start","job_status":"start","queue_duration_s":2.13179,"scheduling_latency_s":2.131811}1356gitlab # [ 256.072790] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"985b77a3055bb7df057f2a2a","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-985b77a3055bb7df057f2a2a: done: 0.015385 sec","job_status":"done","queue_duration_s":2.13179,"scheduling_latency_s":2.131811,"redis_calls":13,"redis_duration_s":0.001492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015385,"completed_at":"2026-09-01T10:30:55.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 256.111361] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a937c6b0edee974b9d35c05b","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a937c6b0edee974b9d35c05b: start","job_status":"start","queue_duration_s":2.148419,"scheduling_latency_s":2.148439}1358gitlab # [ 256.123919] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a937c6b0edee974b9d35c05b","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a937c6b0edee974b9d35c05b: done: 0.015137 sec","job_status":"done","queue_duration_s":2.148419,"scheduling_latency_s":2.148439,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015137,"completed_at":"2026-09-01T10:30:55.862Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 256.162715] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3937fb6c232ff8818bc41b3","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3937fb6c232ff8818bc41b3: start","job_status":"start","queue_duration_s":2.164814,"scheduling_latency_s":2.164833}1360gitlab # [ 256.174980] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3937fb6c232ff8818bc41b3","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3937fb6c232ff8818bc41b3: done: 0.01577 sec","job_status":"done","queue_duration_s":2.164814,"scheduling_latency_s":2.164833,"redis_calls":13,"redis_duration_s":0.0015240000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01577,"completed_at":"2026-09-01T10:30:55.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 256.213309] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fb5abb143c66d81707af1ea","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fb5abb143c66d81707af1ea: start","job_status":"start","queue_duration_s":2.181877,"scheduling_latency_s":2.181896}1362gitlab # [ 256.225637] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fb5abb143c66d81707af1ea","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fb5abb143c66d81707af1ea: done: 0.015562 sec","job_status":"done","queue_duration_s":2.181877,"scheduling_latency_s":2.181896,"redis_calls":13,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015562,"completed_at":"2026-09-01T10:30:55.896Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 256.265844] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"631dc95fdc2684f9bd9f2f98","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-631dc95fdc2684f9bd9f2f98: start","job_status":"start","queue_duration_s":2.19884,"scheduling_latency_s":2.198862}1364gitlab # [ 256.278344] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"631dc95fdc2684f9bd9f2f98","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-631dc95fdc2684f9bd9f2f98: done: 0.016003 sec","job_status":"done","queue_duration_s":2.19884,"scheduling_latency_s":2.198862,"redis_calls":13,"redis_duration_s":0.001655,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016003,"completed_at":"2026-09-01T10:30:55.913Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 256.317638] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6791973f99b4a86e4f33458d","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6791973f99b4a86e4f33458d: start","job_status":"start","queue_duration_s":2.216195,"scheduling_latency_s":2.216216}1366gitlab # [ 256.329871] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6791973f99b4a86e4f33458d","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6791973f99b4a86e4f33458d: done: 0.016224 sec","job_status":"done","queue_duration_s":2.216195,"scheduling_latency_s":2.216216,"redis_calls":13,"redis_duration_s":0.001732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016224,"completed_at":"2026-09-01T10:30:55.931Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 256.368291] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6741fc9a15675c29f877e22","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6741fc9a15675c29f877e22: start","job_status":"start","queue_duration_s":2.233875,"scheduling_latency_s":2.233896}1368gitlab # [ 256.380956] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6741fc9a15675c29f877e22","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6741fc9a15675c29f877e22: done: 0.016279 sec","job_status":"done","queue_duration_s":2.233875,"scheduling_latency_s":2.233896,"redis_calls":13,"redis_duration_s":0.0017,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016279,"completed_at":"2026-09-01T10:30:55.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 256.420149] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2782754e0287bea9cf2f384e","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2782754e0287bea9cf2f384e: start","job_status":"start","queue_duration_s":2.25142,"scheduling_latency_s":2.25144}1370gitlab # [ 256.432413] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2782754e0287bea9cf2f384e","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2782754e0287bea9cf2f384e: done: 0.015284 sec","job_status":"done","queue_duration_s":2.25142,"scheduling_latency_s":2.25144,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015284,"completed_at":"2026-09-01T10:30:55.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 256.471885] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc651df32386f2835fb148cf","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc651df32386f2835fb148cf: start","job_status":"start","queue_duration_s":2.267928,"scheduling_latency_s":2.267947}1372gitlab # [ 256.484213] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc651df32386f2835fb148cf","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc651df32386f2835fb148cf: done: 0.015567 sec","job_status":"done","queue_duration_s":2.267928,"scheduling_latency_s":2.267947,"redis_calls":13,"redis_duration_s":0.001769,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015567,"completed_at":"2026-09-01T10:30:55.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 256.522634] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"970e9661df4167efef2e9582","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-970e9661df4167efef2e9582: start","job_status":"start","queue_duration_s":2.284731,"scheduling_latency_s":2.28475}1374gitlab # [ 256.534651] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:55.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"970e9661df4167efef2e9582","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-970e9661df4167efef2e9582: done: 0.01554 sec","job_status":"done","queue_duration_s":2.284731,"scheduling_latency_s":2.28475,"redis_calls":13,"redis_duration_s":0.001629,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01554,"completed_at":"2026-09-01T10:30:55.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 256.572160] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dea9d93c7ec9e0c81d02cf56","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dea9d93c7ec9e0c81d02cf56: start","job_status":"start","queue_duration_s":2.301568,"scheduling_latency_s":2.301588}1376gitlab # [ 256.584157] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dea9d93c7ec9e0c81d02cf56","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dea9d93c7ec9e0c81d02cf56: done: 0.015302 sec","job_status":"done","queue_duration_s":2.301568,"scheduling_latency_s":2.301588,"redis_calls":13,"redis_duration_s":0.0015500000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015302,"completed_at":"2026-09-01T10:30:56.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 256.622287] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6820f33c9901063df710518","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6820f33c9901063df710518: start","job_status":"start","queue_duration_s":2.318257,"scheduling_latency_s":2.318277}1378gitlab # [ 256.634477] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6820f33c9901063df710518","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6820f33c9901063df710518: done: 0.017063 sec","job_status":"done","queue_duration_s":2.318257,"scheduling_latency_s":2.318277,"redis_calls":13,"redis_duration_s":0.0016849999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017063,"completed_at":"2026-09-01T10:30:56.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 256.674197] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8795d96ed06bda6773ea31a","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8795d96ed06bda6773ea31a: start","job_status":"start","queue_duration_s":2.336657,"scheduling_latency_s":2.336679}1380gitlab # [ 256.686234] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8795d96ed06bda6773ea31a","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8795d96ed06bda6773ea31a: done: 0.016134 sec","job_status":"done","queue_duration_s":2.336657,"scheduling_latency_s":2.336679,"redis_calls":13,"redis_duration_s":0.0016849999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016134,"completed_at":"2026-09-01T10:30:56.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 256.723844] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fc3f4e4c2583614b6ce79f3","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fc3f4e4c2583614b6ce79f3: start","job_status":"start","queue_duration_s":2.354175,"scheduling_latency_s":2.354199}1382gitlab # [ 256.735957] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fc3f4e4c2583614b6ce79f3","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fc3f4e4c2583614b6ce79f3: done: 0.016117 sec","job_status":"done","queue_duration_s":2.354175,"scheduling_latency_s":2.354199,"redis_calls":13,"redis_duration_s":0.001672,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016117,"completed_at":"2026-09-01T10:30:56.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 256.773884] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0611776b22079e33fb816b4","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0611776b22079e33fb816b4: start","job_status":"start","queue_duration_s":2.371605,"scheduling_latency_s":2.371626}1384gitlab # [ 256.785961] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0611776b22079e33fb816b4","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0611776b22079e33fb816b4: done: 0.015339 sec","job_status":"done","queue_duration_s":2.371605,"scheduling_latency_s":2.371626,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015339,"completed_at":"2026-09-01T10:30:56.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 256.824054] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42bdfe28557a067c7d1810d4","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42bdfe28557a067c7d1810d4: start","job_status":"start","queue_duration_s":2.388135,"scheduling_latency_s":2.388154}1386gitlab # [ 256.836079] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42bdfe28557a067c7d1810d4","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42bdfe28557a067c7d1810d4: done: 0.015003 sec","job_status":"done","queue_duration_s":2.388135,"scheduling_latency_s":2.388154,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015003,"completed_at":"2026-09-01T10:30:56.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 256.875646] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22f2b6ae393a337320d4dda3","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22f2b6ae393a337320d4dda3: start","job_status":"start","queue_duration_s":2.404434,"scheduling_latency_s":2.404453}1388gitlab # [ 256.887814] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22f2b6ae393a337320d4dda3","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22f2b6ae393a337320d4dda3: done: 0.015174 sec","job_status":"done","queue_duration_s":2.404434,"scheduling_latency_s":2.404453,"redis_calls":13,"redis_duration_s":0.0016389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015174,"completed_at":"2026-09-01T10:30:56.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 256.925968] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bae5ff80ada8200cc6288604","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bae5ff80ada8200cc6288604: start","job_status":"start","queue_duration_s":2.42088,"scheduling_latency_s":2.4209}1390gitlab # [ 256.937897] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bae5ff80ada8200cc6288604","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bae5ff80ada8200cc6288604: done: 0.015227 sec","job_status":"done","queue_duration_s":2.42088,"scheduling_latency_s":2.4209,"redis_calls":13,"redis_duration_s":0.001569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015227,"completed_at":"2026-09-01T10:30:56.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 256.975999] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e27d1dc7edfd571d788fc456","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e27d1dc7edfd571d788fc456: start","job_status":"start","queue_duration_s":2.437373,"scheduling_latency_s":2.437393}1392gitlab # [ 256.987869] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e27d1dc7edfd571d788fc456","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e27d1dc7edfd571d788fc456: done: 0.01597 sec","job_status":"done","queue_duration_s":2.437373,"scheduling_latency_s":2.437393,"redis_calls":13,"redis_duration_s":0.0016710000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01597,"completed_at":"2026-09-01T10:30:56.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 257.026093] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ffac0721417d4129d1d91e0","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ffac0721417d4129d1d91e0: start","job_status":"start","queue_duration_s":2.454831,"scheduling_latency_s":2.454855}1394gitlab # [ 257.038299] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ffac0721417d4129d1d91e0","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ffac0721417d4129d1d91e0: done: 0.017192 sec","job_status":"done","queue_duration_s":2.454831,"scheduling_latency_s":2.454855,"redis_calls":13,"redis_duration_s":0.001863,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017192,"completed_at":"2026-09-01T10:30:56.171Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 257.077545] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e744fd793ec4d62d2f715a78","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e744fd793ec4d62d2f715a78: start","job_status":"start","queue_duration_s":2.473605,"scheduling_latency_s":2.473632}1396gitlab # [ 257.089595] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e744fd793ec4d62d2f715a78","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e744fd793ec4d62d2f715a78: done: 0.018291 sec","job_status":"done","queue_duration_s":2.473605,"scheduling_latency_s":2.473632,"redis_calls":13,"redis_duration_s":0.001957,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018291,"completed_at":"2026-09-01T10:30:56.190Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 257.127800] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f15950f724995a067345ccd","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f15950f724995a067345ccd: start","job_status":"start","queue_duration_s":2.493476,"scheduling_latency_s":2.493502}1398gitlab # [ 257.140063] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f15950f724995a067345ccd","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f15950f724995a067345ccd: done: 0.018185 sec","job_status":"done","queue_duration_s":2.493476,"scheduling_latency_s":2.493502,"redis_calls":13,"redis_duration_s":0.001967,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018185,"completed_at":"2026-09-01T10:30:56.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 257.177757] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aad4f97604b7390b7de2942f","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aad4f97604b7390b7de2942f: start","job_status":"start","queue_duration_s":2.513309,"scheduling_latency_s":2.513337}1400gitlab # [ 257.189854] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aad4f97604b7390b7de2942f","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aad4f97604b7390b7de2942f: done: 0.017773 sec","job_status":"done","queue_duration_s":2.513309,"scheduling_latency_s":2.513337,"redis_calls":13,"redis_duration_s":0.001922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017773,"completed_at":"2026-09-01T10:30:56.230Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 257.227715] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b346969eb93661efc42a25e8","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b346969eb93661efc42a25e8: start","job_status":"start","queue_duration_s":2.532564,"scheduling_latency_s":2.532588}1402gitlab # [ 257.239918] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b346969eb93661efc42a25e8","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b346969eb93661efc42a25e8: done: 0.01897 sec","job_status":"done","queue_duration_s":2.532564,"scheduling_latency_s":2.532588,"redis_calls":13,"redis_duration_s":0.002176,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001301,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01897,"completed_at":"2026-09-01T10:30:56.250Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 257.279235] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e068681ce36b5e7c4790235","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e068681ce36b5e7c4790235: start","job_status":"start","queue_duration_s":2.553007,"scheduling_latency_s":2.55303}1404gitlab # [ 257.291216] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e068681ce36b5e7c4790235","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e068681ce36b5e7c4790235: done: 0.018917 sec","job_status":"done","queue_duration_s":2.553007,"scheduling_latency_s":2.55303,"redis_calls":13,"redis_duration_s":0.001941,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018917,"completed_at":"2026-09-01T10:30:56.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 257.329796] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a6bb573b6b2782eca60c87d","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a6bb573b6b2782eca60c87d: start","job_status":"start","queue_duration_s":2.573227,"scheduling_latency_s":2.573248}1406gitlab # [ 257.341815] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a6bb573b6b2782eca60c87d","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a6bb573b6b2782eca60c87d: done: 0.016633 sec","job_status":"done","queue_duration_s":2.573227,"scheduling_latency_s":2.573248,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016633,"completed_at":"2026-09-01T10:30:56.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 257.379605] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97eb9bf59ea1e41b6acdadc7","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97eb9bf59ea1e41b6acdadc7: start","job_status":"start","queue_duration_s":2.591224,"scheduling_latency_s":2.591243}1408gitlab # [ 257.391637] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97eb9bf59ea1e41b6acdadc7","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97eb9bf59ea1e41b6acdadc7: done: 0.016369 sec","job_status":"done","queue_duration_s":2.591224,"scheduling_latency_s":2.591243,"redis_calls":13,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016369,"completed_at":"2026-09-01T10:30:56.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 257.429531] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50e138ea16a3ede88e7eee57","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50e138ea16a3ede88e7eee57: start","job_status":"start","queue_duration_s":2.609136,"scheduling_latency_s":2.609158}1410gitlab # [ 257.441507] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50e138ea16a3ede88e7eee57","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50e138ea16a3ede88e7eee57: done: 0.017379 sec","job_status":"done","queue_duration_s":2.609136,"scheduling_latency_s":2.609158,"redis_calls":13,"redis_duration_s":0.0016519999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017379,"completed_at":"2026-09-01T10:30:56.325Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 257.480707] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1d5f19ba9cdd4188fb5d7c6","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1d5f19ba9cdd4188fb5d7c6: start","job_status":"start","queue_duration_s":2.628011,"scheduling_latency_s":2.628033}1412gitlab # [ 257.492528] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1d5f19ba9cdd4188fb5d7c6","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1d5f19ba9cdd4188fb5d7c6: done: 0.016651 sec","job_status":"done","queue_duration_s":2.628011,"scheduling_latency_s":2.628033,"redis_calls":13,"redis_duration_s":0.001695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016651,"completed_at":"2026-09-01T10:30:56.343Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 257.530234] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4d2cc8f47fc42f245e526c0","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4d2cc8f47fc42f245e526c0: start","job_status":"start","queue_duration_s":2.646156,"scheduling_latency_s":2.646178}1414gitlab # [ 257.542372] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4d2cc8f47fc42f245e526c0","created_at":"2026-09-01T10:30:53.593Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-c1e66d75556a434f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"71440aa12b0ea9dc9f6a728c6cfa5f7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.699Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4d2cc8f47fc42f245e526c0: done: 0.016416 sec","job_status":"done","queue_duration_s":2.646156,"scheduling_latency_s":2.646178,"redis_calls":13,"redis_duration_s":0.001815,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016416,"completed_at":"2026-09-01T10:30:56.361Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 257.580254] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.363Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"13f46b261ee83c2ac30c1776","created_at":"2026-09-01T10:30:53.757Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-34aef4e7de6e431f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"baae43f8ffd19b9f9e62514fd2d2f73d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.769Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-13f46b261ee83c2ac30c1776: start","job_status":"start","queue_duration_s":2.593436,"scheduling_latency_s":2.593458}1416gitlab # [ 257.594675] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.393Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"13f46b261ee83c2ac30c1776","created_at":"2026-09-01T10:30:53.757Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-34aef4e7de6e431f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"baae43f8ffd19b9f9e62514fd2d2f73d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.769Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-13f46b261ee83c2ac30c1776: done: 0.030356 sec","job_status":"done","queue_duration_s":2.593436,"scheduling_latency_s":2.593458,"redis_calls":10,"redis_duration_s":0.0016460000000000001,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000357,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000328,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034968,"duration_s":0.030356,"completed_at":"2026-09-01T10:30:56.393Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004387,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 257.637516] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.394Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"3b6fef2d5a02209bbcf85eba","created_at":"2026-09-01T10:30:53.771Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-34aef4e7de6e431f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"baae43f8ffd19b9f9e62514fd2d2f73d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.778Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-3b6fef2d5a02209bbcf85eba: start","job_status":"start","queue_duration_s":2.616791,"scheduling_latency_s":2.616812}1418gitlab # [ 257.652445] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.419Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"3b6fef2d5a02209bbcf85eba","created_at":"2026-09-01T10:30:53.771Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-34aef4e7de6e431f","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"baae43f8ffd19b9f9e62514fd2d2f73d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-09-01T10:30:53.778Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-3b6fef2d5a02209bbcf85eba: done: 0.024507 sec","job_status":"done","queue_duration_s":2.616791,"scheduling_latency_s":2.616812,"redis_calls":10,"redis_duration_s":0.001473,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000322,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026914,"duration_s":0.024507,"completed_at":"2026-09-01T10:30:56.419Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001542,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 257.696409] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.420Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"79e39ebe5ecf948a7825d940","created_at":"2026-09-01T10:30:54.894Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-ca118b831878461c","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"219341370213a39ee9b244b093e81cdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:54.908Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-79e39ebe5ecf948a7825d940: start","job_status":"start","queue_duration_s":1.512606,"scheduling_latency_s":1.512626}1420gitlab # [ 257.708775] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.439Z","message":"No existing merge request to be cleaned up."}1421gitlab # [ 257.710465] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.455Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"79e39ebe5ecf948a7825d940","created_at":"2026-09-01T10:30:54.894Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-ca118b831878461c","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"219341370213a39ee9b244b093e81cdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:54.908Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-79e39ebe5ecf948a7825d940: done: 0.034342 sec","job_status":"done","queue_duration_s":1.512606,"scheduling_latency_s":1.512626,"redis_calls":13,"redis_duration_s":0.001965,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000345,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000269,"duration_s":0.034342,"completed_at":"2026-09-01T10:30:56.455Z","load_balancing_strategy":"primary","db_duration_s":0.006292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 257.750608] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.456Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"844eb9bcba1fd15fe593c951","created_at":"2026-09-01T10:30:54.894Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-ca118b831878461c","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"219341370213a39ee9b244b093e81cdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:54.908Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-844eb9bcba1fd15fe593c951: start","job_status":"start","queue_duration_s":1.548488,"scheduling_latency_s":1.54851}1423gitlab # [ 257.763074] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.469Z","message":"No existing merge request to be cleaned up."}1424gitlab # [ 257.764791] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.481Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"844eb9bcba1fd15fe593c951","created_at":"2026-09-01T10:30:54.894Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-ca118b831878461c","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"219341370213a39ee9b244b093e81cdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:54.908Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-844eb9bcba1fd15fe593c951: done: 0.025064 sec","job_status":"done","queue_duration_s":1.548488,"scheduling_latency_s":1.54851,"redis_calls":10,"redis_duration_s":0.00179,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025064,"completed_at":"2026-09-01T10:30:56.481Z","load_balancing_strategy":"primary","db_duration_s":0.003703,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 257.803629] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.483Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a6dabde69eb2c654fc3ad264","created_at":"2026-09-01T10:30:54.894Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-ca118b831878461c","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"219341370213a39ee9b244b093e81cdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:54.908Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a6dabde69eb2c654fc3ad264: start","job_status":"start","queue_duration_s":1.575061,"scheduling_latency_s":1.575088}1426gitlab # [ 257.816112] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.497Z","message":"No existing merge request to be cleaned up."}1427gitlab # [ 257.817803] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.511Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a6dabde69eb2c654fc3ad264","created_at":"2026-09-01T10:30:54.894Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-ca118b831878461c","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"219341370213a39ee9b244b093e81cdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:54.908Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a6dabde69eb2c654fc3ad264: done: 0.027943 sec","job_status":"done","queue_duration_s":1.575061,"scheduling_latency_s":1.575088,"redis_calls":10,"redis_duration_s":0.002033,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027943,"completed_at":"2026-09-01T10:30:56.511Z","load_balancing_strategy":"primary","db_duration_s":0.00396,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 257.856099] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.513Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1bdbf5ddbf3395c5205d3eca","created_at":"2026-09-01T10:30:54.894Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-ca118b831878461c","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"219341370213a39ee9b244b093e81cdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:54.908Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1bdbf5ddbf3395c5205d3eca: start","job_status":"start","queue_duration_s":1.604755,"scheduling_latency_s":1.604784}1429gitlab # [ 257.868336] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.528Z","message":"No existing merge request to be cleaned up."}1430gitlab # [ 257.870006] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:30:56.541Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1bdbf5ddbf3395c5205d3eca","created_at":"2026-09-01T10:30:54.894Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-ca118b831878461c","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"219341370213a39ee9b244b093e81cdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:30:54.908Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1bdbf5ddbf3395c5205d3eca: done: 0.028702 sec","job_status":"done","queue_duration_s":1.604755,"scheduling_latency_s":1.604784,"redis_calls":10,"redis_duration_s":0.001964,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001075,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028702,"completed_at":"2026-09-01T10:30:56.541Z","load_balancing_strategy":"primary","db_duration_s":0.004148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 264.634695] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:05.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e8db748ab4bf7e8dc51f83f4","created_at":"2026-09-01T10:31:05.331Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed164793139e70f9968d02d1d02f27bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e8db748ab4bf7e8dc51f83f4: start","job_status":"start","queue_duration_s":0.007565,"scheduling_latency_s":0.007631}1432gitlab # [ 264.790667] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:05.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e8db748ab4bf7e8dc51f83f4","created_at":"2026-09-01T10:31:05.331Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed164793139e70f9968d02d1d02f27bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.352Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e8db748ab4bf7e8dc51f83f4: done: 0.157081 sec","job_status":"done","queue_duration_s":0.007565,"scheduling_latency_s":0.007631,"redis_calls":7,"redis_duration_s":0.043695000000000005,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.037171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006524,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.157081,"completed_at":"2026-09-01T10:31:05.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 264.883352] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:05.525Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ec82320ed8cb07aa4795ae55","created_at":"2026-09-01T10:31:05.384Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4339524bab1ed4c45668abec51e2ddb6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.391Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ec82320ed8cb07aa4795ae55: start","job_status":"start","queue_duration_s":0.134144,"scheduling_latency_s":0.134208}1434gitlab # [ 266.112653] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:06.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ec82320ed8cb07aa4795ae55","created_at":"2026-09-01T10:31:05.384Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4339524bab1ed4c45668abec51e2ddb6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.391Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ec82320ed8cb07aa4795ae55: done: 1.313625 sec","job_status":"done","queue_duration_s":0.134144,"scheduling_latency_s":0.134208,"redis_calls":562,"redis_duration_s":0.7357969999999999,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.733999,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.631123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.313625,"completed_at":"2026-09-01T10:31:06.838Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 266.113266] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:06.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5c7326746045eaecff2b24b5","created_at":"2026-09-01T10:31:05.470Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9be60cf026f03a3a8634f9115db5508d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.492Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5c7326746045eaecff2b24b5: start","job_status":"start","queue_duration_s":1.347969,"scheduling_latency_s":1.347999}1436gitlab # [ 266.212206] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:06.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5c7326746045eaecff2b24b5","created_at":"2026-09-01T10:31:05.470Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9be60cf026f03a3a8634f9115db5508d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.492Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5c7326746045eaecff2b24b5: done: 0.025443 sec","job_status":"done","queue_duration_s":1.347969,"scheduling_latency_s":1.347999,"redis_calls":9,"redis_duration_s":0.003248,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00069534,"exclusive_lock_hold_duration_s":0.00660698,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.025443,"completed_at":"2026-09-01T10:31:06.866Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 266.272586] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:06.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1722b7735fa9337406c52088","created_at":"2026-09-01T10:31:05.510Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20d42c3b5b70308b8119c30a41a9064d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.521Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1722b7735fa9337406c52088: start","job_status":"start","queue_duration_s":1.346211,"scheduling_latency_s":1.34624}1438gitlab # [ 266.286995] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:06.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1722b7735fa9337406c52088","created_at":"2026-09-01T10:31:05.510Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20d42c3b5b70308b8119c30a41a9064d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.521Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1722b7735fa9337406c52088: done: 0.017261 sec","job_status":"done","queue_duration_s":1.346211,"scheduling_latency_s":1.34624,"redis_calls":7,"redis_duration_s":0.001971,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017261,"completed_at":"2026-09-01T10:31:06.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 266.329866] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:06.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c5b105bf2858c34962b8ea73","created_at":"2026-09-01T10:31:05.552Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c260646cbae83eea6ed2cd4d754795aa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.560Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c5b105bf2858c34962b8ea73: start","job_status":"start","queue_duration_s":1.326411,"scheduling_latency_s":1.326435}1440gitlab # [ 266.344690] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c5b105bf2858c34962b8ea73","created_at":"2026-09-01T10:31:05.552Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c260646cbae83eea6ed2cd4d754795aa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.560Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c5b105bf2858c34962b8ea73: done: 0.15029 sec","job_status":"done","queue_duration_s":1.326411,"scheduling_latency_s":1.326435,"redis_calls":9,"redis_duration_s":0.003803,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001944,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001859,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00071894,"exclusive_lock_hold_duration_s":0.123707,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.15029,"completed_at":"2026-09-01T10:31:07.037Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.102472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 266.388338] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.041Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"24d9bb1abd0cd655654a1666","created_at":"2026-09-01T10:31:05.681Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7c0e00a57812232697acfa2004fea90","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.708Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-24d9bb1abd0cd655654a1666: start","job_status":"start","queue_duration_s":1.332971,"scheduling_latency_s":1.333026}1442gitlab # [ 266.403096] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.088Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"24d9bb1abd0cd655654a1666","created_at":"2026-09-01T10:31:05.681Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7c0e00a57812232697acfa2004fea90","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.708Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-24d9bb1abd0cd655654a1666: done: 0.047079 sec","job_status":"done","queue_duration_s":1.332971,"scheduling_latency_s":1.333026,"redis_calls":10,"redis_duration_s":0.0035000000000000005,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002024,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01195116,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.047079,"completed_at":"2026-09-01T10:31:07.088Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005122,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1443gitlab # [ 266.446532] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9c9f67169ebddaff1459737a","created_at":"2026-09-01T10:31:05.769Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d70e32f880bfd072ed99d0f2a78059c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:31:05.779Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9c9f67169ebddaff1459737a: start","job_status":"start","queue_duration_s":1.310546,"scheduling_latency_s":1.310577}1444gitlab # [ 266.460004] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.101Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1445gitlab # [ 266.463259] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.109Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9c9f67169ebddaff1459737a","created_at":"2026-09-01T10:31:05.769Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d70e32f880bfd072ed99d0f2a78059c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:31:05.779Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9c9f67169ebddaff1459737a: done: 0.018953 sec","job_status":"done","queue_duration_s":1.310546,"scheduling_latency_s":1.310577,"redis_calls":7,"redis_duration_s":0.001551,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018953,"completed_at":"2026-09-01T10:31:07.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 266.503354] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.111Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"97d1541b3a5da821c005867a","created_at":"2026-09-01T10:31:05.833Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fff5e6660ecb4fe0a52523323cd8788","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.843Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-97d1541b3a5da821c005867a: start","job_status":"start","queue_duration_s":1.26772,"scheduling_latency_s":1.267746}1447gitlab # [ 266.517249] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"97d1541b3a5da821c005867a","created_at":"2026-09-01T10:31:05.833Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fff5e6660ecb4fe0a52523323cd8788","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.843Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-97d1541b3a5da821c005867a: done: 0.02807 sec","job_status":"done","queue_duration_s":1.26772,"scheduling_latency_s":1.267746,"redis_calls":7,"redis_duration_s":0.001483,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.02807,"completed_at":"2026-09-01T10:31:07.139Z","load_balancing_strategy":"primary","db_duration_s":0.009271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 266.558751] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"882715f07a92a2c2054ef9bc","created_at":"2026-09-01T10:31:05.895Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"007fd0791fe5b936b2ec04ac88fd6554","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.906Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-882715f07a92a2c2054ef9bc: start","job_status":"start","queue_duration_s":1.234273,"scheduling_latency_s":1.234299}1449gitlab # [ 266.573245] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"882715f07a92a2c2054ef9bc","created_at":"2026-09-01T10:31:05.895Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"007fd0791fe5b936b2ec04ac88fd6554","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.906Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-882715f07a92a2c2054ef9bc: done: 0.019029 sec","job_status":"done","queue_duration_s":1.234273,"scheduling_latency_s":1.234299,"redis_calls":7,"redis_duration_s":0.0014199999999999998,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019029,"completed_at":"2026-09-01T10:31:07.159Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 266.614134] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.161Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7e4446c230d7abb3e99819b5","created_at":"2026-09-01T10:31:05.947Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.959Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7e4446c230d7abb3e99819b5: start","job_status":"start","queue_duration_s":1.202011,"scheduling_latency_s":1.202033}1451gitlab # [ 266.627883] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7e4446c230d7abb3e99819b5","created_at":"2026-09-01T10:31:05.947Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.959Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7e4446c230d7abb3e99819b5: done: 0.093246 sec","job_status":"done","queue_duration_s":1.202011,"scheduling_latency_s":1.202033,"redis_calls":60,"redis_duration_s":0.009059,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000618,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.008001,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.093246,"completed_at":"2026-09-01T10:31:07.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 266.669576] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b91e192a8dbab8112f2f6e24","created_at":"2026-09-01T10:31:05.982Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c57a97e9c6f2ddbd0f9cb6d2432e22e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.995Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b91e192a8dbab8112f2f6e24: start","job_status":"start","queue_duration_s":1.259707,"scheduling_latency_s":1.259732}1453gitlab # [ 266.684294] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.263Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1454gitlab # [ 266.688035] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b91e192a8dbab8112f2f6e24","created_at":"2026-09-01T10:31:05.982Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c57a97e9c6f2ddbd0f9cb6d2432e22e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:05.995Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b91e192a8dbab8112f2f6e24: done: 0.014712 sec","job_status":"done","queue_duration_s":1.259707,"scheduling_latency_s":1.259732,"redis_calls":7,"redis_duration_s":0.00108,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014712,"completed_at":"2026-09-01T10:31:07.270Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 266.730425] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"88dbb06785d653ff342c519c","created_at":"2026-09-01T10:31:06.056Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ff1ec07583febd8872f896f249b6811","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:31:06.066Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-88dbb06785d653ff342c519c: start","job_status":"start","queue_duration_s":1.205392,"scheduling_latency_s":1.205412}1456gitlab # [ 266.743888] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.294Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"88dbb06785d653ff342c519c","created_at":"2026-09-01T10:31:06.056Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ff1ec07583febd8872f896f249b6811","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:31:06.066Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-88dbb06785d653ff342c519c: done: 0.02267 sec","job_status":"done","queue_duration_s":1.205392,"scheduling_latency_s":1.205412,"redis_calls":7,"redis_duration_s":0.001039,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02267,"completed_at":"2026-09-01T10:31:07.294Z","load_balancing_strategy":"primary","db_duration_s":0.002041,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 266.783487] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.295Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"fbfa5e8c2c4d38203793e034","created_at":"2026-09-01T10:31:06.111Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adfdfe7e6370138d129d40a93ac56017","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.122Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-fbfa5e8c2c4d38203793e034: start","job_status":"start","queue_duration_s":1.172837,"scheduling_latency_s":1.172858}1458gitlab # [ 266.840934] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.568Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"fbfa5e8c2c4d38203793e034","created_at":"2026-09-01T10:31:06.111Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adfdfe7e6370138d129d40a93ac56017","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.122Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-fbfa5e8c2c4d38203793e034: done: 0.272736 sec","job_status":"done","queue_duration_s":1.172837,"scheduling_latency_s":1.172858,"redis_calls":9,"redis_duration_s":0.00167,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.054,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.054,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.202587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005498,"exclusive_lock_hold_duration_s":0.25649458,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.272736,"completed_at":"2026-09-01T10:31:07.568Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.083184,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 266.889905] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.569Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ec67aae54c668a377d8d3352","created_at":"2026-09-01T10:31:06.158Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d748a0a38e47d63bccde55b0e34ff4b6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.170Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ec67aae54c668a377d8d3352: start","job_status":"start","queue_duration_s":1.399596,"scheduling_latency_s":1.399622}1460gitlab # [ 266.905573] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.596Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ec67aae54c668a377d8d3352","created_at":"2026-09-01T10:31:06.158Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d748a0a38e47d63bccde55b0e34ff4b6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.170Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ec67aae54c668a377d8d3352: done: 0.026751 sec","job_status":"done","queue_duration_s":1.399596,"scheduling_latency_s":1.399622,"redis_calls":7,"redis_duration_s":0.001099,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026751,"completed_at":"2026-09-01T10:31:07.596Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 266.946832] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2e971b893f0ee5e667ee75a7","created_at":"2026-09-01T10:31:06.197Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81ecf3ed5c7e554b1aab280c81a4bf76","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.209Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2e971b893f0ee5e667ee75a7: start","job_status":"start","queue_duration_s":1.388849,"scheduling_latency_s":1.388874}1462gitlab # [ 266.960424] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.617Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2e971b893f0ee5e667ee75a7","created_at":"2026-09-01T10:31:06.197Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81ecf3ed5c7e554b1aab280c81a4bf76","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.209Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2e971b893f0ee5e667ee75a7: done: 0.019551 sec","job_status":"done","queue_duration_s":1.388849,"scheduling_latency_s":1.388874,"redis_calls":9,"redis_duration_s":0.001471,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000726,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00052038,"exclusive_lock_hold_duration_s":0.00487044,"duration_s":0.019551,"completed_at":"2026-09-01T10:31:07.617Z","load_balancing_strategy":"primary","db_duration_s":0.002315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 266.999903] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d45cf45e58e76f932be518eb","created_at":"2026-09-01T10:31:06.246Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52704ff9cb46f1c82f5265c7fb7fd48a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.258Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d45cf45e58e76f932be518eb: start","job_status":"start","queue_duration_s":1.359926,"scheduling_latency_s":1.359946}1464gitlab # [ 267.014318] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d45cf45e58e76f932be518eb","created_at":"2026-09-01T10:31:06.246Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52704ff9cb46f1c82f5265c7fb7fd48a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.258Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d45cf45e58e76f932be518eb: done: 0.052439 sec","job_status":"done","queue_duration_s":1.359926,"scheduling_latency_s":1.359946,"redis_calls":9,"redis_duration_s":0.0018479999999999998,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00063356,"exclusive_lock_hold_duration_s":0.02675352,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.052439,"completed_at":"2026-09-01T10:31:07.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 267.059221] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"26caf6c451776b26fcd81276","created_at":"2026-09-01T10:31:06.289Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d04ce0444efc08b3e452480c2fb86fba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.300Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-26caf6c451776b26fcd81276: start","job_status":"start","queue_duration_s":1.372402,"scheduling_latency_s":1.372427}1466gitlab # [ 267.073846] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.681Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1467gitlab # [ 267.077447] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.687Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"26caf6c451776b26fcd81276","created_at":"2026-09-01T10:31:06.289Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d04ce0444efc08b3e452480c2fb86fba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.300Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-26caf6c451776b26fcd81276: done: 0.014824 sec","job_status":"done","queue_duration_s":1.372402,"scheduling_latency_s":1.372427,"redis_calls":7,"redis_duration_s":0.0011480000000000001,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014824,"completed_at":"2026-09-01T10:31:07.687Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 267.118756] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"8b3e42baa9eeb7eedbb8676c","created_at":"2026-09-01T10:31:06.355Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ad71018b122e1255c23180c73a524f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.368Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-8b3e42baa9eeb7eedbb8676c: start","job_status":"start","queue_duration_s":1.320102,"scheduling_latency_s":1.320122}1469gitlab # [ 267.133158] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.696Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1470gitlab # [ 267.136429] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.702Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"8b3e42baa9eeb7eedbb8676c","created_at":"2026-09-01T10:31:06.355Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ad71018b122e1255c23180c73a524f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.368Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-8b3e42baa9eeb7eedbb8676c: done: 0.013448 sec","job_status":"done","queue_duration_s":1.320102,"scheduling_latency_s":1.320122,"redis_calls":7,"redis_duration_s":0.000949,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013448,"completed_at":"2026-09-01T10:31:07.702Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 267.175929] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.703Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"6c8e20270f749a8d736d3b8c","created_at":"2026-09-01T10:31:06.393Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0c818ebd8db47862c0d68f156e36397","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.405Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-6c8e20270f749a8d736d3b8c: start","job_status":"start","queue_duration_s":1.298005,"scheduling_latency_s":1.298023}1472gitlab # [ 267.189860] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.711Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1473gitlab # [ 267.192950] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.716Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"6c8e20270f749a8d736d3b8c","created_at":"2026-09-01T10:31:06.393Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0c818ebd8db47862c0d68f156e36397","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.405Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-6c8e20270f749a8d736d3b8c: done: 0.013253 sec","job_status":"done","queue_duration_s":1.298005,"scheduling_latency_s":1.298023,"redis_calls":7,"redis_duration_s":0.000966,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013253,"completed_at":"2026-09-01T10:31:07.716Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 267.232416] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"29156a79705a34729f3a0f88","created_at":"2026-09-01T10:31:06.442Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"841187595358bed8b7f2f4ce4714f80c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:31:06.453Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-29156a79705a34729f3a0f88: start","job_status":"start","queue_duration_s":1.264525,"scheduling_latency_s":1.264544}1475gitlab # [ 267.245336] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.725Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1476gitlab # [ 267.248970] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.731Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"29156a79705a34729f3a0f88","created_at":"2026-09-01T10:31:06.442Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"841187595358bed8b7f2f4ce4714f80c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:31:06.453Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-29156a79705a34729f3a0f88: done: 0.013109 sec","job_status":"done","queue_duration_s":1.264525,"scheduling_latency_s":1.264544,"redis_calls":7,"redis_duration_s":0.0009620000000000001,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013109,"completed_at":"2026-09-01T10:31:07.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 267.287403] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0a46965998985089aa48637d","created_at":"2026-09-01T10:31:06.513Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2badd79c1f0718b04db24c1cf4f632e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.526Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0a46965998985089aa48637d: start","job_status":"start","queue_duration_s":1.205671,"scheduling_latency_s":1.20569}1478gitlab # [ 267.300706] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.763Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0a46965998985089aa48637d","created_at":"2026-09-01T10:31:06.513Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2badd79c1f0718b04db24c1cf4f632e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:31:06.526Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0a46965998985089aa48637d: done: 0.031289 sec","job_status":"done","queue_duration_s":1.205671,"scheduling_latency_s":1.20569,"redis_calls":14,"redis_duration_s":0.002439,"redis_read_bytes":16,"redis_write_bytes":4022,"redis_queues_calls":2,"redis_queues_duration_s":0.00027,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001628,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031289,"completed_at":"2026-09-01T10:31:07.763Z","load_balancing_strategy":"primary","db_duration_s":0.002718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 267.341610] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cac82a036b5db4f2e75f579c","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cac82a036b5db4f2e75f579c: start","job_status":"start","queue_duration_s":0.519227,"scheduling_latency_s":0.519256}1480gitlab # [ 267.353560] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cac82a036b5db4f2e75f579c","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cac82a036b5db4f2e75f579c: done: 0.019695 sec","job_status":"done","queue_duration_s":0.519227,"scheduling_latency_s":0.519256,"redis_calls":13,"redis_duration_s":0.002149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001351,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019695,"completed_at":"2026-09-01T10:31:07.785Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 267.391741] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd1d2eb1012c835b610a1b87","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd1d2eb1012c835b610a1b87: start","job_status":"start","queue_duration_s":0.54057,"scheduling_latency_s":0.540601}1482gitlab # [ 267.404141] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd1d2eb1012c835b610a1b87","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd1d2eb1012c835b610a1b87: done: 0.01849 sec","job_status":"done","queue_duration_s":0.54057,"scheduling_latency_s":0.540601,"redis_calls":13,"redis_duration_s":0.001925,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01849,"completed_at":"2026-09-01T10:31:07.805Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 267.442398] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab9decad172462275f5c0357","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab9decad172462275f5c0357: start","job_status":"start","queue_duration_s":0.560524,"scheduling_latency_s":0.560549}1484gitlab # [ 267.454582] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab9decad172462275f5c0357","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab9decad172462275f5c0357: done: 0.017525 sec","job_status":"done","queue_duration_s":0.560524,"scheduling_latency_s":0.560549,"redis_calls":13,"redis_duration_s":0.001852,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017525,"completed_at":"2026-09-01T10:31:07.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 267.492503] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29bcd5d51ec044301af80689","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29bcd5d51ec044301af80689: start","job_status":"start","queue_duration_s":0.579492,"scheduling_latency_s":0.579515}1486gitlab # [ 267.504534] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29bcd5d51ec044301af80689","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29bcd5d51ec044301af80689: done: 0.017562 sec","job_status":"done","queue_duration_s":0.579492,"scheduling_latency_s":0.579515,"redis_calls":13,"redis_duration_s":0.001922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017562,"completed_at":"2026-09-01T10:31:07.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 267.543828] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16c95c87a1858b73c7d02bf1","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16c95c87a1858b73c7d02bf1: start","job_status":"start","queue_duration_s":0.598393,"scheduling_latency_s":0.598413}1488gitlab # [ 267.556258] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16c95c87a1858b73c7d02bf1","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16c95c87a1858b73c7d02bf1: done: 0.015241 sec","job_status":"done","queue_duration_s":0.598393,"scheduling_latency_s":0.598413,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015241,"completed_at":"2026-09-01T10:31:07.859Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 267.594844] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cab62a187413851e85b3b122","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cab62a187413851e85b3b122: start","job_status":"start","queue_duration_s":0.61481,"scheduling_latency_s":0.61483}1490gitlab # [ 267.607149] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cab62a187413851e85b3b122","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cab62a187413851e85b3b122: done: 0.015139 sec","job_status":"done","queue_duration_s":0.61481,"scheduling_latency_s":0.61483,"redis_calls":13,"redis_duration_s":0.0017200000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015139,"completed_at":"2026-09-01T10:31:07.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 267.645907] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e68332afaff2e173d5bc58d","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e68332afaff2e173d5bc58d: start","job_status":"start","queue_duration_s":0.631136,"scheduling_latency_s":0.631155}1492gitlab # [ 267.657992] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e68332afaff2e173d5bc58d","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e68332afaff2e173d5bc58d: done: 0.014827 sec","job_status":"done","queue_duration_s":0.631136,"scheduling_latency_s":0.631155,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014827,"completed_at":"2026-09-01T10:31:07.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 267.696308] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a71ca713f484e3f311a9b4d","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a71ca713f484e3f311a9b4d: start","job_status":"start","queue_duration_s":0.647179,"scheduling_latency_s":0.647199}1494gitlab # [ 267.708309] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a71ca713f484e3f311a9b4d","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a71ca713f484e3f311a9b4d: done: 0.014859 sec","job_status":"done","queue_duration_s":0.647179,"scheduling_latency_s":0.647199,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014859,"completed_at":"2026-09-01T10:31:07.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 267.747742] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7767fc6f65be3e578d3ab968","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7767fc6f65be3e578d3ab968: start","job_status":"start","queue_duration_s":0.663236,"scheduling_latency_s":0.663257}1496gitlab # [ 267.760094] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7767fc6f65be3e578d3ab968","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7767fc6f65be3e578d3ab968: done: 0.015195 sec","job_status":"done","queue_duration_s":0.663236,"scheduling_latency_s":0.663257,"redis_calls":13,"redis_duration_s":0.0015439999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015195,"completed_at":"2026-09-01T10:31:07.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 267.797900] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a93be5e3fccba303089a443d","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a93be5e3fccba303089a443d: start","job_status":"start","queue_duration_s":0.679718,"scheduling_latency_s":0.679739}1498gitlab # [ 267.809876] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a93be5e3fccba303089a443d","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a93be5e3fccba303089a443d: done: 0.015505 sec","job_status":"done","queue_duration_s":0.679718,"scheduling_latency_s":0.679739,"redis_calls":13,"redis_duration_s":0.001632,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015505,"completed_at":"2026-09-01T10:31:07.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 267.848052] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"090e4a523fc036a8b6afe106","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-090e4a523fc036a8b6afe106: start","job_status":"start","queue_duration_s":0.696466,"scheduling_latency_s":0.696486}1500gitlab # [ 267.860330] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"090e4a523fc036a8b6afe106","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-090e4a523fc036a8b6afe106: done: 0.014951 sec","job_status":"done","queue_duration_s":0.696466,"scheduling_latency_s":0.696486,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014951,"completed_at":"2026-09-01T10:31:07.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 267.898908] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e12ed34d5144eab7116d7a5","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e12ed34d5144eab7116d7a5: start","job_status":"start","queue_duration_s":0.712543,"scheduling_latency_s":0.712561}1502gitlab # [ 267.911346] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e12ed34d5144eab7116d7a5","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e12ed34d5144eab7116d7a5: done: 0.015009 sec","job_status":"done","queue_duration_s":0.712543,"scheduling_latency_s":0.712561,"redis_calls":13,"redis_duration_s":0.0014789999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015009,"completed_at":"2026-09-01T10:31:07.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 267.951546] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:07.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d659c05b547d35df6667ccb7","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d659c05b547d35df6667ccb7: start","job_status":"start","queue_duration_s":0.728692,"scheduling_latency_s":0.728711}1504gitlab # [ 267.963616] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d659c05b547d35df6667ccb7","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d659c05b547d35df6667ccb7: done: 0.096204 sec","job_status":"done","queue_duration_s":0.728692,"scheduling_latency_s":0.728711,"redis_calls":13,"redis_duration_s":0.001859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.096204,"completed_at":"2026-09-01T10:31:08.071Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 268.002426] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"733e3672fb7a873aa45d9ae1","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-733e3672fb7a873aa45d9ae1: start","job_status":"start","queue_duration_s":0.826648,"scheduling_latency_s":0.826676}1506gitlab # [ 268.014558] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"733e3672fb7a873aa45d9ae1","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-733e3672fb7a873aa45d9ae1: done: 0.017038 sec","job_status":"done","queue_duration_s":0.826648,"scheduling_latency_s":0.826676,"redis_calls":13,"redis_duration_s":0.001647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017038,"completed_at":"2026-09-01T10:31:08.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 268.052131] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa58971c6d0ea6002b86a1c7","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa58971c6d0ea6002b86a1c7: start","job_status":"start","queue_duration_s":0.84493,"scheduling_latency_s":0.844952}1508gitlab # [ 268.063986] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa58971c6d0ea6002b86a1c7","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa58971c6d0ea6002b86a1c7: done: 0.016583 sec","job_status":"done","queue_duration_s":0.84493,"scheduling_latency_s":0.844952,"redis_calls":13,"redis_duration_s":0.001627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016583,"completed_at":"2026-09-01T10:31:08.107Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 268.101936] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da4baade97850e588af2cb25","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da4baade97850e588af2cb25: start","job_status":"start","queue_duration_s":0.862943,"scheduling_latency_s":0.862963}1510gitlab # [ 268.113950] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da4baade97850e588af2cb25","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da4baade97850e588af2cb25: done: 0.017049 sec","job_status":"done","queue_duration_s":0.862943,"scheduling_latency_s":0.862963,"redis_calls":13,"redis_duration_s":0.001825,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001278,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017049,"completed_at":"2026-09-01T10:31:08.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 268.153978] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0cb576009da5e76bc06a6d0","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0cb576009da5e76bc06a6d0: start","job_status":"start","queue_duration_s":0.881164,"scheduling_latency_s":0.881183}1512gitlab # [ 268.166261] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0cb576009da5e76bc06a6d0","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0cb576009da5e76bc06a6d0: done: 0.016581 sec","job_status":"done","queue_duration_s":0.881164,"scheduling_latency_s":0.881183,"redis_calls":13,"redis_duration_s":0.0017209999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016581,"completed_at":"2026-09-01T10:31:08.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 268.204902] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c451c41c3074eead854cb1e","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c451c41c3074eead854cb1e: start","job_status":"start","queue_duration_s":0.899088,"scheduling_latency_s":0.899108}1514gitlab # [ 268.217054] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c451c41c3074eead854cb1e","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c451c41c3074eead854cb1e: done: 0.016109 sec","job_status":"done","queue_duration_s":0.899088,"scheduling_latency_s":0.899108,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016109,"completed_at":"2026-09-01T10:31:08.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 268.255548] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b819173acfa56414f87c3fda","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b819173acfa56414f87c3fda: start","job_status":"start","queue_duration_s":0.916412,"scheduling_latency_s":0.916432}1516gitlab # [ 268.267908] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b819173acfa56414f87c3fda","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b819173acfa56414f87c3fda: done: 0.017331 sec","job_status":"done","queue_duration_s":0.916412,"scheduling_latency_s":0.916432,"redis_calls":13,"redis_duration_s":0.001866,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001278,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017331,"completed_at":"2026-09-01T10:31:08.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 268.306504] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e00d4e76e99a8639b7e21705","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e00d4e76e99a8639b7e21705: start","job_status":"start","queue_duration_s":0.935108,"scheduling_latency_s":0.935129}1518gitlab # [ 268.318835] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e00d4e76e99a8639b7e21705","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e00d4e76e99a8639b7e21705: done: 0.016692 sec","job_status":"done","queue_duration_s":0.935108,"scheduling_latency_s":0.935129,"redis_calls":13,"redis_duration_s":0.001751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016692,"completed_at":"2026-09-01T10:31:08.198Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 268.358621] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1263b38478b58e1f5a3af456","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1263b38478b58e1f5a3af456: start","job_status":"start","queue_duration_s":0.953084,"scheduling_latency_s":0.953104}1520gitlab # [ 268.370931] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1263b38478b58e1f5a3af456","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1263b38478b58e1f5a3af456: done: 0.017329 sec","job_status":"done","queue_duration_s":0.953084,"scheduling_latency_s":0.953104,"redis_calls":13,"redis_duration_s":0.0018639999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017329,"completed_at":"2026-09-01T10:31:08.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 268.409922] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9f42a1496cf7e295170a7df","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9f42a1496cf7e295170a7df: start","job_status":"start","queue_duration_s":0.971732,"scheduling_latency_s":0.971751}1522gitlab # [ 268.422086] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9f42a1496cf7e295170a7df","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9f42a1496cf7e295170a7df: done: 0.015646 sec","job_status":"done","queue_duration_s":0.971732,"scheduling_latency_s":0.971751,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015646,"completed_at":"2026-09-01T10:31:08.233Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 268.460044] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ca1198d1afa01aaaafc4f76","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ca1198d1afa01aaaafc4f76: start","job_status":"start","queue_duration_s":0.988513,"scheduling_latency_s":0.988533}1524gitlab # [ 268.472147] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ca1198d1afa01aaaafc4f76","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ca1198d1afa01aaaafc4f76: done: 0.01632 sec","job_status":"done","queue_duration_s":0.988513,"scheduling_latency_s":0.988533,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01632,"completed_at":"2026-09-01T10:31:08.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 268.510385] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faca94620aeae9c7422d7b16","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faca94620aeae9c7422d7b16: start","job_status":"start","queue_duration_s":1.006083,"scheduling_latency_s":1.006102}1526gitlab # [ 268.522621] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.268Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faca94620aeae9c7422d7b16","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faca94620aeae9c7422d7b16: done: 0.016313 sec","job_status":"done","queue_duration_s":1.006083,"scheduling_latency_s":1.006102,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016313,"completed_at":"2026-09-01T10:31:08.268Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 268.562594] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cb204f7bb46dcc0e9269b3e","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cb204f7bb46dcc0e9269b3e: start","job_status":"start","queue_duration_s":1.023642,"scheduling_latency_s":1.023661}1528gitlab # [ 268.574798] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cb204f7bb46dcc0e9269b3e","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cb204f7bb46dcc0e9269b3e: done: 0.018307 sec","job_status":"done","queue_duration_s":1.023642,"scheduling_latency_s":1.023661,"redis_calls":13,"redis_duration_s":0.0018900000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018307,"completed_at":"2026-09-01T10:31:08.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 268.612974] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb9f3732a982258dad3860fd","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb9f3732a982258dad3860fd: start","job_status":"start","queue_duration_s":1.043505,"scheduling_latency_s":1.043535}1530gitlab # [ 268.624935] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb9f3732a982258dad3860fd","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb9f3732a982258dad3860fd: done: 0.020667 sec","job_status":"done","queue_duration_s":1.043505,"scheduling_latency_s":1.043535,"redis_calls":13,"redis_duration_s":0.002036,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000794,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001242,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020667,"completed_at":"2026-09-01T10:31:08.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 268.662831] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e663fa4ebbab05b7c4428560","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e663fa4ebbab05b7c4428560: start","job_status":"start","queue_duration_s":1.065735,"scheduling_latency_s":1.065765}1532gitlab # [ 268.674750] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e663fa4ebbab05b7c4428560","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e663fa4ebbab05b7c4428560: done: 0.019223 sec","job_status":"done","queue_duration_s":1.065735,"scheduling_latency_s":1.065765,"redis_calls":13,"redis_duration_s":0.0019169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001158,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019223,"completed_at":"2026-09-01T10:31:08.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 268.712642] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a5af94e67030c3bd01b96ee","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a5af94e67030c3bd01b96ee: start","job_status":"start","queue_duration_s":1.086503,"scheduling_latency_s":1.08653}1534gitlab # [ 268.724615] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a5af94e67030c3bd01b96ee","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a5af94e67030c3bd01b96ee: done: 0.019358 sec","job_status":"done","queue_duration_s":1.086503,"scheduling_latency_s":1.08653,"redis_calls":13,"redis_duration_s":0.00198,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019358,"completed_at":"2026-09-01T10:31:08.352Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 268.763771] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45c80739fcb6f319203525dc","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45c80739fcb6f319203525dc: start","job_status":"start","queue_duration_s":1.107388,"scheduling_latency_s":1.107415}1536gitlab # [ 268.776002] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45c80739fcb6f319203525dc","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45c80739fcb6f319203525dc: done: 0.023069 sec","job_status":"done","queue_duration_s":1.107388,"scheduling_latency_s":1.107415,"redis_calls":13,"redis_duration_s":0.001854,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023069,"completed_at":"2026-09-01T10:31:08.376Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 268.813665] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdfc23bfb72a3126b9b269b5","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdfc23bfb72a3126b9b269b5: start","job_status":"start","queue_duration_s":1.131973,"scheduling_latency_s":1.131997}1538gitlab # [ 268.825782] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdfc23bfb72a3126b9b269b5","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdfc23bfb72a3126b9b269b5: done: 0.018876 sec","job_status":"done","queue_duration_s":1.131973,"scheduling_latency_s":1.131997,"redis_calls":13,"redis_duration_s":0.002036,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001333,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018876,"completed_at":"2026-09-01T10:31:08.397Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 268.863828] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"334008c67c8c85d5f15099a2","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-334008c67c8c85d5f15099a2: start","job_status":"start","queue_duration_s":1.15223,"scheduling_latency_s":1.152252}1540gitlab # [ 268.876047] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"334008c67c8c85d5f15099a2","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-334008c67c8c85d5f15099a2: done: 0.017966 sec","job_status":"done","queue_duration_s":1.15223,"scheduling_latency_s":1.152252,"redis_calls":13,"redis_duration_s":0.00186,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001154,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017966,"completed_at":"2026-09-01T10:31:08.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 268.913711] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83bce5ff52aeba4a23625639","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83bce5ff52aeba4a23625639: start","job_status":"start","queue_duration_s":1.171496,"scheduling_latency_s":1.171516}1542gitlab # [ 268.925628] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83bce5ff52aeba4a23625639","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83bce5ff52aeba4a23625639: done: 0.017623 sec","job_status":"done","queue_duration_s":1.171496,"scheduling_latency_s":1.171516,"redis_calls":13,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017623,"completed_at":"2026-09-01T10:31:08.435Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 268.964387] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8bffcacf9150bf5069668ff","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8bffcacf9150bf5069668ff: start","job_status":"start","queue_duration_s":1.190376,"scheduling_latency_s":1.190395}1544gitlab # [ 268.976324] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8bffcacf9150bf5069668ff","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8bffcacf9150bf5069668ff: done: 0.016634 sec","job_status":"done","queue_duration_s":1.190376,"scheduling_latency_s":1.190395,"redis_calls":13,"redis_duration_s":0.001586,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016634,"completed_at":"2026-09-01T10:31:08.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 269.014359] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3c426873d625d5894c24478","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3c426873d625d5894c24478: start","job_status":"start","queue_duration_s":1.208215,"scheduling_latency_s":1.208234}1546gitlab # [ 269.026437] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3c426873d625d5894c24478","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3c426873d625d5894c24478: done: 0.016779 sec","job_status":"done","queue_duration_s":1.208215,"scheduling_latency_s":1.208234,"redis_calls":13,"redis_duration_s":0.0016520000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016779,"completed_at":"2026-09-01T10:31:08.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 269.064363] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b793cf5f8cc86a862c645f8c","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b793cf5f8cc86a862c645f8c: start","job_status":"start","queue_duration_s":1.22628,"scheduling_latency_s":1.2263}1548gitlab # [ 269.076379] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b793cf5f8cc86a862c645f8c","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b793cf5f8cc86a862c645f8c: done: 0.018812 sec","job_status":"done","queue_duration_s":1.22628,"scheduling_latency_s":1.2263,"redis_calls":13,"redis_duration_s":0.0016650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018812,"completed_at":"2026-09-01T10:31:08.491Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 269.114442] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f53ed9279150a132c0b25992","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f53ed9279150a132c0b25992: start","job_status":"start","queue_duration_s":1.24747,"scheduling_latency_s":1.247491}1550gitlab # [ 269.126458] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f53ed9279150a132c0b25992","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f53ed9279150a132c0b25992: done: 0.019972 sec","job_status":"done","queue_duration_s":1.24747,"scheduling_latency_s":1.247491,"redis_calls":13,"redis_duration_s":0.0034419999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002395,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019972,"completed_at":"2026-09-01T10:31:08.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 269.165865] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fad7f2e3719712e4cd031993","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fad7f2e3719712e4cd031993: start","job_status":"start","queue_duration_s":1.26907,"scheduling_latency_s":1.26909}1552gitlab # [ 269.177880] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fad7f2e3719712e4cd031993","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fad7f2e3719712e4cd031993: done: 0.018806 sec","job_status":"done","queue_duration_s":1.26907,"scheduling_latency_s":1.26909,"redis_calls":13,"redis_duration_s":0.0031219999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001041,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018806,"completed_at":"2026-09-01T10:31:08.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 269.216098] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a9992da05cef15c499217ec","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a9992da05cef15c499217ec: start","job_status":"start","queue_duration_s":1.290874,"scheduling_latency_s":1.290896}1554gitlab # [ 269.228145] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a9992da05cef15c499217ec","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a9992da05cef15c499217ec: done: 0.019472 sec","job_status":"done","queue_duration_s":1.290874,"scheduling_latency_s":1.290896,"redis_calls":13,"redis_duration_s":0.003248,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00217,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019472,"completed_at":"2026-09-01T10:31:08.556Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 269.266299] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dfb0c656259fb49b30f4fe1","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dfb0c656259fb49b30f4fe1: start","job_status":"start","queue_duration_s":1.311962,"scheduling_latency_s":1.31198}1556gitlab # [ 269.278654] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dfb0c656259fb49b30f4fe1","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dfb0c656259fb49b30f4fe1: done: 0.018452 sec","job_status":"done","queue_duration_s":1.311962,"scheduling_latency_s":1.31198,"redis_calls":13,"redis_duration_s":0.0029579999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018452,"completed_at":"2026-09-01T10:31:08.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 269.316492] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5baa0a65618950b25e619190","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5baa0a65618950b25e619190: start","job_status":"start","queue_duration_s":1.332065,"scheduling_latency_s":1.332083}1558gitlab # [ 269.328420] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5baa0a65618950b25e619190","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5baa0a65618950b25e619190: done: 0.017113 sec","job_status":"done","queue_duration_s":1.332065,"scheduling_latency_s":1.332083,"redis_calls":13,"redis_duration_s":0.002747,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001803,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017113,"completed_at":"2026-09-01T10:31:08.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 269.367678] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bedb67e7282211fd119a0f4d","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bedb67e7282211fd119a0f4d: start","job_status":"start","queue_duration_s":1.353818,"scheduling_latency_s":1.353836}1560gitlab # [ 269.379911] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bedb67e7282211fd119a0f4d","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bedb67e7282211fd119a0f4d: done: 0.018245 sec","job_status":"done","queue_duration_s":1.353818,"scheduling_latency_s":1.353836,"redis_calls":13,"redis_duration_s":0.002819,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018245,"completed_at":"2026-09-01T10:31:08.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 269.417723] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de8c19374ba8ce5c74c3f022","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de8c19374ba8ce5c74c3f022: start","job_status":"start","queue_duration_s":1.373556,"scheduling_latency_s":1.373573}1562gitlab # [ 269.429702] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de8c19374ba8ce5c74c3f022","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de8c19374ba8ce5c74c3f022: done: 0.017919 sec","job_status":"done","queue_duration_s":1.373556,"scheduling_latency_s":1.373573,"redis_calls":13,"redis_duration_s":0.0029170000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017919,"completed_at":"2026-09-01T10:31:08.637Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 269.467752] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"879324ad1209452a34a1b33c","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-879324ad1209452a34a1b33c: start","job_status":"start","queue_duration_s":1.392983,"scheduling_latency_s":1.393002}1564gitlab # [ 269.479876] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"879324ad1209452a34a1b33c","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-879324ad1209452a34a1b33c: done: 0.02004 sec","job_status":"done","queue_duration_s":1.392983,"scheduling_latency_s":1.393002,"redis_calls":13,"redis_duration_s":0.00296,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02004,"completed_at":"2026-09-01T10:31:08.659Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 269.517746] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eed9f3440ffc8c2f254f05cd","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eed9f3440ffc8c2f254f05cd: start","job_status":"start","queue_duration_s":1.414639,"scheduling_latency_s":1.414657}1566gitlab # [ 269.529884] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eed9f3440ffc8c2f254f05cd","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eed9f3440ffc8c2f254f05cd: done: 0.019025 sec","job_status":"done","queue_duration_s":1.414639,"scheduling_latency_s":1.414657,"redis_calls":13,"redis_duration_s":0.003682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002577,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019025,"completed_at":"2026-09-01T10:31:08.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 269.569238] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef6abe9ab9377358fa072350","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef6abe9ab9377358fa072350: start","job_status":"start","queue_duration_s":1.435308,"scheduling_latency_s":1.435326}1568gitlab # [ 269.581290] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef6abe9ab9377358fa072350","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef6abe9ab9377358fa072350: done: 0.017721 sec","job_status":"done","queue_duration_s":1.435308,"scheduling_latency_s":1.435326,"redis_calls":13,"redis_duration_s":0.003104,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00206,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017721,"completed_at":"2026-09-01T10:31:08.699Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 269.618936] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9e44f04010a3f77a95d588d","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9e44f04010a3f77a95d588d: start","job_status":"start","queue_duration_s":1.45515,"scheduling_latency_s":1.455168}1570gitlab # [ 269.631002] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9e44f04010a3f77a95d588d","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9e44f04010a3f77a95d588d: done: 0.020356 sec","job_status":"done","queue_duration_s":1.45515,"scheduling_latency_s":1.455168,"redis_calls":13,"redis_duration_s":0.003257,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001439,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001818,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020356,"completed_at":"2026-09-01T10:31:08.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 269.668893] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed86555b8a09213af61ea932","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed86555b8a09213af61ea932: start","job_status":"start","queue_duration_s":1.476933,"scheduling_latency_s":1.47695}1572gitlab # [ 269.680726] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed86555b8a09213af61ea932","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed86555b8a09213af61ea932: done: 0.016367 sec","job_status":"done","queue_duration_s":1.476933,"scheduling_latency_s":1.47695,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001689,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016367,"completed_at":"2026-09-01T10:31:08.739Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 269.717911] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bba488c92a4d2265c4a925be","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bba488c92a4d2265c4a925be: start","job_status":"start","queue_duration_s":1.495324,"scheduling_latency_s":1.495342}1574gitlab # [ 269.729927] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bba488c92a4d2265c4a925be","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bba488c92a4d2265c4a925be: done: 0.017037 sec","job_status":"done","queue_duration_s":1.495324,"scheduling_latency_s":1.495342,"redis_calls":13,"redis_duration_s":0.002848,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017037,"completed_at":"2026-09-01T10:31:08.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 269.769086] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfcd5433309afb4b05d63454","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfcd5433309afb4b05d63454: start","job_status":"start","queue_duration_s":1.513928,"scheduling_latency_s":1.513948}1576gitlab # [ 269.781124] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfcd5433309afb4b05d63454","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfcd5433309afb4b05d63454: done: 0.018002 sec","job_status":"done","queue_duration_s":1.513928,"scheduling_latency_s":1.513948,"redis_calls":13,"redis_duration_s":0.003176,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018002,"completed_at":"2026-09-01T10:31:08.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 269.819452] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd5768e7a16205cf9481b3ee","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd5768e7a16205cf9481b3ee: start","job_status":"start","queue_duration_s":1.534426,"scheduling_latency_s":1.53445}1578gitlab # [ 269.831626] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd5768e7a16205cf9481b3ee","created_at":"2026-09-01T10:31:07.170Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-7ea2b5a017cb4cc6","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f9ac75c3ff014a2fb4ec85f1d2582a51","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.246Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd5768e7a16205cf9481b3ee: done: 0.018603 sec","job_status":"done","queue_duration_s":1.534426,"scheduling_latency_s":1.53445,"redis_calls":13,"redis_duration_s":0.003142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001068,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018603,"completed_at":"2026-09-01T10:31:08.799Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 269.868962] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.800Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"55d1387437290c7f2dcb3c9b","created_at":"2026-09-01T10:31:07.745Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-3f210686b5064d6a","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f2badd79c1f0718b04db24c1cf4f632e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.757Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-55d1387437290c7f2dcb3c9b: start","job_status":"start","queue_duration_s":1.043854,"scheduling_latency_s":1.043877}1580gitlab # [ 269.880727] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.816Z","message":"No existing merge request to be cleaned up."}1581gitlab # [ 269.882396] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.828Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"55d1387437290c7f2dcb3c9b","created_at":"2026-09-01T10:31:07.745Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-3f210686b5064d6a","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f2badd79c1f0718b04db24c1cf4f632e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.757Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-55d1387437290c7f2dcb3c9b: done: 0.0279 sec","job_status":"done","queue_duration_s":1.043854,"scheduling_latency_s":1.043877,"redis_calls":10,"redis_duration_s":0.003036,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001268,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001768,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0279,"completed_at":"2026-09-01T10:31:08.828Z","load_balancing_strategy":"primary","db_duration_s":0.004343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582gitlab # [ 269.919276] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.830Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ba3a156dd214dc018292f7e7","created_at":"2026-09-01T10:31:07.745Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-3f210686b5064d6a","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f2badd79c1f0718b04db24c1cf4f632e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.757Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ba3a156dd214dc018292f7e7: start","job_status":"start","queue_duration_s":1.073597,"scheduling_latency_s":1.073624}1583gitlab # [ 269.931227] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.844Z","message":"No existing merge request to be cleaned up."}1584gitlab # [ 269.932936] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.854Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ba3a156dd214dc018292f7e7","created_at":"2026-09-01T10:31:07.745Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-3f210686b5064d6a","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f2badd79c1f0718b04db24c1cf4f632e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.757Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ba3a156dd214dc018292f7e7: done: 0.023897 sec","job_status":"done","queue_duration_s":1.073597,"scheduling_latency_s":1.073624,"redis_calls":10,"redis_duration_s":0.0032570000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001598,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023897,"completed_at":"2026-09-01T10:31:08.854Z","load_balancing_strategy":"primary","db_duration_s":0.002885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 269.972150] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.856Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"deff560f14a95019ced22333","created_at":"2026-09-01T10:31:07.745Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-3f210686b5064d6a","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f2badd79c1f0718b04db24c1cf4f632e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.757Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-deff560f14a95019ced22333: start","job_status":"start","queue_duration_s":1.099083,"scheduling_latency_s":1.099105}1586gitlab # [ 269.984320] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.869Z","message":"No existing merge request to be cleaned up."}1587gitlab # [ 269.985978] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.883Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"deff560f14a95019ced22333","created_at":"2026-09-01T10:31:07.745Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-3f210686b5064d6a","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f2badd79c1f0718b04db24c1cf4f632e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.757Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-deff560f14a95019ced22333: done: 0.027239 sec","job_status":"done","queue_duration_s":1.099083,"scheduling_latency_s":1.099105,"redis_calls":10,"redis_duration_s":0.00409,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002692,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027239,"completed_at":"2026-09-01T10:31:08.883Z","load_balancing_strategy":"primary","db_duration_s":0.00388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588gitlab # [ 270.023865] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.885Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"206b34554b307cf8384586cb","created_at":"2026-09-01T10:31:07.745Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-3f210686b5064d6a","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f2badd79c1f0718b04db24c1cf4f632e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.757Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-206b34554b307cf8384586cb: start","job_status":"start","queue_duration_s":1.128484,"scheduling_latency_s":1.128511}1589gitlab # [ 270.036137] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.903Z","message":"No existing merge request to be cleaned up."}1590gitlab # [ 270.037811] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:31:08.918Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"206b34554b307cf8384586cb","created_at":"2026-09-01T10:31:07.745Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-3f210686b5064d6a","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f2badd79c1f0718b04db24c1cf4f632e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:31:07.757Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-206b34554b307cf8384586cb: done: 0.033334 sec","job_status":"done","queue_duration_s":1.128484,"scheduling_latency_s":1.128511,"redis_calls":10,"redis_duration_s":0.0034980000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001975,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033334,"completed_at":"2026-09-01T10:31:08.918Z","load_balancing_strategy":"primary","db_duration_s":0.003615,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 291.740383] setup-gitlab-start[3067]: W, [2026-09-01T10:31:32.466989 #3067] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1592gitlab # [ 309.325984] redis[789]: 10 changes in 300 seconds. Saving...1593gitlab # [ 309.331310] redis[789]: Background saving started by pid 33461594gitlab # [ 309.342408] redis[3346]: BGSAVE done, 535 keys saved, 0 keys skipped, 132485 bytes written.1595gitlab # [ 309.351594] redis[3346]: DB saved on disk1596gitlab # [ 309.353922] redis[3346]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1597gitlab # [ 309.429871] redis[789]: Background saving terminated with success1598gitlab # [ 311.340562] postgres[858]: [858] LOG: checkpoint starting: time1599gitlab # [ 312.801663] gitaly[902]: time="2026-09-01T10:31:53.528Z" level=info msg="burden monitor stats" pid=9021600gitlab # [ 322.239155] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:02.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b1b240d39dca5ce06bf32958","created_at":"2026-09-01T10:32:02.872Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"77dfa1703c8e6f2877380c90a4bfcd12","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:02.955Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b1b240d39dca5ce06bf32958: start","job_status":"start","queue_duration_s":0.009109,"scheduling_latency_s":0.009179}1601gitlab # [ 322.632296] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:03.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b1b240d39dca5ce06bf32958","created_at":"2026-09-01T10:32:02.872Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"77dfa1703c8e6f2877380c90a4bfcd12","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:02.955Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b1b240d39dca5ce06bf32958: done: 0.393897 sec","job_status":"done","queue_duration_s":0.009109,"scheduling_latency_s":0.009179,"redis_calls":16,"redis_duration_s":0.10577399999999999,"redis_read_bytes":1157,"redis_write_bytes":1478,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.078722,"redis_feature_flag_read_bytes":1152,"redis_feature_flag_write_bytes":647,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017039,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.010013,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.393897,"completed_at":"2026-09-01T10:32:03.358Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602gitlab # [ 322.723109] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:03.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"21efb1066cd2aaf544d9ede9","created_at":"2026-09-01T10:32:02.984Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33e8ddba1d5f386752e90bde50d41c93","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.016Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-21efb1066cd2aaf544d9ede9: start","job_status":"start","queue_duration_s":0.349656,"scheduling_latency_s":0.349718}1603gitlab # [ 325.168481] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:05.894Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"21efb1066cd2aaf544d9ede9","created_at":"2026-09-01T10:32:02.984Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33e8ddba1d5f386752e90bde50d41c93","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.016Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-21efb1066cd2aaf544d9ede9: done: 2.528111 sec","job_status":"done","queue_duration_s":0.349656,"scheduling_latency_s":0.349718,"redis_calls":563,"redis_duration_s":1.467838,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000319,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.465183,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.976639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":2.528111,"completed_at":"2026-09-01T10:32:05.894Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 325.169463] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:05.897Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"44e8deaf3c85f6926934810b","created_at":"2026-09-01T10:32:03.048Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83302b38575fb99fba3cd23303646cd5","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.069Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-44e8deaf3c85f6926934810b: start","job_status":"start","queue_duration_s":2.827593,"scheduling_latency_s":2.827632}1605gitlab # [ 325.281244] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:05.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"44e8deaf3c85f6926934810b","created_at":"2026-09-01T10:32:03.048Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83302b38575fb99fba3cd23303646cd5","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.069Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-44e8deaf3c85f6926934810b: done: 0.030898 sec","job_status":"done","queue_duration_s":2.827593,"scheduling_latency_s":2.827632,"redis_calls":9,"redis_duration_s":0.002411,"redis_read_bytes":261,"redis_write_bytes":937,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":151,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030898,"completed_at":"2026-09-01T10:32:05.927Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001672,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 325.332693] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:05.929Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"592d634b6e2b8181c9a7f1ac","created_at":"2026-09-01T10:32:03.095Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94df4417d90ccda28fc05ffdbf0f02fc","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.111Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-592d634b6e2b8181c9a7f1ac: start","job_status":"start","queue_duration_s":2.818595,"scheduling_latency_s":2.818628}1607gitlab # [ 325.347163] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:05.951Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"592d634b6e2b8181c9a7f1ac","created_at":"2026-09-01T10:32:03.095Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94df4417d90ccda28fc05ffdbf0f02fc","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.111Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-592d634b6e2b8181c9a7f1ac: done: 0.021417 sec","job_status":"done","queue_duration_s":2.818595,"scheduling_latency_s":2.818628,"redis_calls":10,"redis_duration_s":0.00183,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00014,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000811,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005919,"exclusive_lock_hold_duration_s":0.0031578,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.021417,"completed_at":"2026-09-01T10:32:05.951Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000691,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 325.389653] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:05.952Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d73cacc84064b05fff608d27","created_at":"2026-09-01T10:32:03.144Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c695ab055b31d234e72c630d46ac550d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.174Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d73cacc84064b05fff608d27: start","job_status":"start","queue_duration_s":2.77844,"scheduling_latency_s":2.778461}1609gitlab # [ 325.403789] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:05.967Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d73cacc84064b05fff608d27","created_at":"2026-09-01T10:32:03.144Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c695ab055b31d234e72c630d46ac550d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.174Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d73cacc84064b05fff608d27: done: 0.01485 sec","job_status":"done","queue_duration_s":2.77844,"scheduling_latency_s":2.778461,"redis_calls":8,"redis_duration_s":0.001107,"redis_read_bytes":133,"redis_write_bytes":879,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000118,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":103,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01485,"completed_at":"2026-09-01T10:32:05.967Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 325.444984] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:05.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"25bf2f1e446e01d07265599d","created_at":"2026-09-01T10:32:03.248Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2538c249b314f7674df5fc367f91eb57","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.275Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-25bf2f1e446e01d07265599d: start","job_status":"start","queue_duration_s":2.693191,"scheduling_latency_s":2.693212}1611gitlab # [ 325.459092] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"25bf2f1e446e01d07265599d","created_at":"2026-09-01T10:32:03.248Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2538c249b314f7674df5fc367f91eb57","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.275Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-25bf2f1e446e01d07265599d: done: 0.04123 sec","job_status":"done","queue_duration_s":2.693191,"scheduling_latency_s":2.693212,"redis_calls":11,"redis_duration_s":0.002033,"redis_read_bytes":263,"redis_write_bytes":1334,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":172,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00049614,"exclusive_lock_hold_duration_s":0.0225412,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.04123,"completed_at":"2026-09-01T10:32:06.009Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009535,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1612gitlab # [ 325.503571] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"fcad294835e5d8f5b3fa3c70","created_at":"2026-09-01T10:32:03.333Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8937b65757f245018e7b20d55b49db53","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.362Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-fcad294835e5d8f5b3fa3c70: start","job_status":"start","queue_duration_s":2.658656,"scheduling_latency_s":2.658691}1613gitlab # [ 325.517931] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.062Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"fcad294835e5d8f5b3fa3c70","created_at":"2026-09-01T10:32:03.333Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8937b65757f245018e7b20d55b49db53","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.362Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-fcad294835e5d8f5b3fa3c70: done: 0.041493 sec","job_status":"done","queue_duration_s":2.658656,"scheduling_latency_s":2.658691,"redis_calls":11,"redis_duration_s":0.00379,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002031,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001495,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00850378,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.041493,"completed_at":"2026-09-01T10:32:06.062Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003058,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1614gitlab # [ 325.561061] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"9185e6e7fef424ccac8fd5c1","created_at":"2026-09-01T10:32:03.419Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.541Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-9185e6e7fef424ccac8fd5c1: start","job_status":"start","queue_duration_s":2.523168,"scheduling_latency_s":2.523207}1615gitlab # [ 325.574200] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.196Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"9185e6e7fef424ccac8fd5c1","created_at":"2026-09-01T10:32:03.419Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.541Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-9185e6e7fef424ccac8fd5c1: done: 0.131364 sec","job_status":"done","queue_duration_s":2.523168,"scheduling_latency_s":2.523207,"redis_calls":65,"redis_duration_s":0.018668999999999998,"redis_read_bytes":114,"redis_write_bytes":41332,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001568,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000996,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37035,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.015099,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000727,"duration_s":0.131364,"completed_at":"2026-09-01T10:32:06.196Z","load_balancing_strategy":"primary","db_duration_s":0.001623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1616gitlab # [ 325.615918] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.198Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4670390c7e29ca4890e66dec","created_at":"2026-09-01T10:32:03.565Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4675c2985e2679359d50b655b78fdf0a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:32:03.579Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4670390c7e29ca4890e66dec: start","job_status":"start","queue_duration_s":2.618574,"scheduling_latency_s":2.618604}1617gitlab # [ 325.629383] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.208Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1618gitlab # [ 325.632622] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4670390c7e29ca4890e66dec","created_at":"2026-09-01T10:32:03.565Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4675c2985e2679359d50b655b78fdf0a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:32:03.579Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4670390c7e29ca4890e66dec: done: 0.017076 sec","job_status":"done","queue_duration_s":2.618574,"scheduling_latency_s":2.618604,"redis_calls":8,"redis_duration_s":0.00216,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000235,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000557,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017076,"completed_at":"2026-09-01T10:32:06.215Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 325.673306] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0eca93618f6bfd8e3b16f010","created_at":"2026-09-01T10:32:03.666Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fd7457a6ea9eef7200e305eff220fa2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.690Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0eca93618f6bfd8e3b16f010: start","job_status":"start","queue_duration_s":2.52688,"scheduling_latency_s":2.526908}1620gitlab # [ 325.688110] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0eca93618f6bfd8e3b16f010","created_at":"2026-09-01T10:32:03.666Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fd7457a6ea9eef7200e305eff220fa2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.690Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0eca93618f6bfd8e3b16f010: done: 0.023171 sec","job_status":"done","queue_duration_s":2.52688,"scheduling_latency_s":2.526908,"redis_calls":8,"redis_duration_s":0.002237,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000226,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001481,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00053,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.023171,"completed_at":"2026-09-01T10:32:06.240Z","load_balancing_strategy":"primary","db_duration_s":0.00394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 325.729884] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9e118b52c6c26543c525887e","created_at":"2026-09-01T10:32:03.752Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e026263ddce53da29af86abaff20858b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.781Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9e118b52c6c26543c525887e: start","job_status":"start","queue_duration_s":2.460462,"scheduling_latency_s":2.460491}1622gitlab # [ 325.743884] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9e118b52c6c26543c525887e","created_at":"2026-09-01T10:32:03.752Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e026263ddce53da29af86abaff20858b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.781Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9e118b52c6c26543c525887e: done: 0.020147 sec","job_status":"done","queue_duration_s":2.460462,"scheduling_latency_s":2.460491,"redis_calls":8,"redis_duration_s":0.0023380000000000002,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001564,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020147,"completed_at":"2026-09-01T10:32:06.262Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000933,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 325.784795] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f25a175612d1b75ea30c7d8a","created_at":"2026-09-01T10:32:03.838Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.864Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f25a175612d1b75ea30c7d8a: start","job_status":"start","queue_duration_s":2.399739,"scheduling_latency_s":2.399793}1624gitlab # [ 325.797839] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f25a175612d1b75ea30c7d8a","created_at":"2026-09-01T10:32:03.838Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.864Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f25a175612d1b75ea30c7d8a: done: 0.09947 sec","job_status":"done","queue_duration_s":2.399739,"scheduling_latency_s":2.399793,"redis_calls":65,"redis_duration_s":0.017222,"redis_read_bytes":749,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.001659,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.001128,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.01364,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.09947,"completed_at":"2026-09-01T10:32:06.363Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 325.840134] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.365Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5d1a53e74259e9b04dcd4685","created_at":"2026-09-01T10:32:03.904Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b8b882e39c779b278aa5251f6aac4f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.933Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5d1a53e74259e9b04dcd4685: start","job_status":"start","queue_duration_s":2.432107,"scheduling_latency_s":2.432131}1626gitlab # [ 325.881665] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.374Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1627gitlab # [ 325.890397] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5d1a53e74259e9b04dcd4685","created_at":"2026-09-01T10:32:03.904Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b8b882e39c779b278aa5251f6aac4f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:03.933Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5d1a53e74259e9b04dcd4685: done: 0.015849 sec","job_status":"done","queue_duration_s":2.432107,"scheduling_latency_s":2.432131,"redis_calls":8,"redis_duration_s":0.002627,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001306,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015849,"completed_at":"2026-09-01T10:32:06.380Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 325.981979] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c9306bc11acdbc30b018fa3e","created_at":"2026-09-01T10:32:03.971Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc88593ef3e5d42827ba104a9e7b8d32","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:32:03.997Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c9306bc11acdbc30b018fa3e: start","job_status":"start","queue_duration_s":2.385524,"scheduling_latency_s":2.385543}1629gitlab # [ 326.001832] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.406Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c9306bc11acdbc30b018fa3e","created_at":"2026-09-01T10:32:03.971Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc88593ef3e5d42827ba104a9e7b8d32","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:32:03.997Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c9306bc11acdbc30b018fa3e: done: 0.023878 sec","job_status":"done","queue_duration_s":2.385524,"scheduling_latency_s":2.385543,"redis_calls":8,"redis_duration_s":0.002168,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000226,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023878,"completed_at":"2026-09-01T10:32:06.406Z","load_balancing_strategy":"primary","db_duration_s":0.001748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 326.047142] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.408Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"37e38767c8a282310db31070","created_at":"2026-09-01T10:32:04.046Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"48c8707bfc68b025cea63c50feea5e62","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.104Z","job_size_bytes":3,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-37e38767c8a282310db31070: start","job_status":"start","queue_duration_s":2.303801,"scheduling_latency_s":2.30382}1631gitlab # [ 326.061501] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.452Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"37e38767c8a282310db31070","created_at":"2026-09-01T10:32:04.046Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"48c8707bfc68b025cea63c50feea5e62","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.104Z","job_size_bytes":3,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-37e38767c8a282310db31070: done: 0.044242 sec","job_status":"done","queue_duration_s":2.303801,"scheduling_latency_s":2.30382,"redis_calls":10,"redis_duration_s":0.003197,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000608,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001756,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000833,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061922,"duration_s":0.044242,"completed_at":"2026-09-01T10:32:06.452Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 326.105195] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.455Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"8b9e93d5556c6fca6bef5a7b","created_at":"2026-09-01T10:32:04.159Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea0f723ccd2239f3b3a19105733bad2c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.186Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-8b9e93d5556c6fca6bef5a7b: start","job_status":"start","queue_duration_s":2.269368,"scheduling_latency_s":2.269411}1633gitlab # [ 326.119025] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.779Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"8b9e93d5556c6fca6bef5a7b","created_at":"2026-09-01T10:32:04.159Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea0f723ccd2239f3b3a19105733bad2c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.186Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-8b9e93d5556c6fca6bef5a7b: done: 0.324493 sec","job_status":"done","queue_duration_s":2.269368,"scheduling_latency_s":2.269411,"redis_calls":11,"redis_duration_s":0.003436,"redis_read_bytes":263,"redis_write_bytes":1140,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000523,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":153,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001464,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":129,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.269076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00105696,"exclusive_lock_hold_duration_s":0.29549534,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.324493,"completed_at":"2026-09-01T10:32:06.779Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.068308,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 326.163474] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.781Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2f6b21a7917f9998ab356221","created_at":"2026-09-01T10:32:04.239Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3956fa9a8e59d1f419863daaa49c9db4","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.269Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2f6b21a7917f9998ab356221: start","job_status":"start","queue_duration_s":2.511719,"scheduling_latency_s":2.511745}1635gitlab # [ 326.177772] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.808Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2f6b21a7917f9998ab356221","created_at":"2026-09-01T10:32:04.239Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3956fa9a8e59d1f419863daaa49c9db4","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.269Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2f6b21a7917f9998ab356221: done: 0.026972 sec","job_status":"done","queue_duration_s":2.511719,"scheduling_latency_s":2.511745,"redis_calls":11,"redis_duration_s":0.002073,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000665,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000419,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026972,"completed_at":"2026-09-01T10:32:06.808Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 326.219437] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e43bd6065331c169eee6c958","created_at":"2026-09-01T10:32:04.310Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1b54f33db6d88018d655d81d95346b1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.346Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e43bd6065331c169eee6c958: start","job_status":"start","queue_duration_s":2.463716,"scheduling_latency_s":2.463742}1637gitlab # [ 326.233185] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.830Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e43bd6065331c169eee6c958","created_at":"2026-09-01T10:32:04.310Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1b54f33db6d88018d655d81d95346b1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.346Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e43bd6065331c169eee6c958: done: 0.020207 sec","job_status":"done","queue_duration_s":2.463716,"scheduling_latency_s":2.463742,"redis_calls":10,"redis_duration_s":0.001812,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000123,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00072084,"exclusive_lock_hold_duration_s":0.00324088,"duration_s":0.020207,"completed_at":"2026-09-01T10:32:06.830Z","load_balancing_strategy":"primary","db_duration_s":0.000556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 326.274578] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.831Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a4b19c5ba806f410a39f069b","created_at":"2026-09-01T10:32:04.401Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cecb8d3a645e1f29b57bd67e00e0b9e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.427Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a4b19c5ba806f410a39f069b: start","job_status":"start","queue_duration_s":2.404345,"scheduling_latency_s":2.404366}1639gitlab # [ 326.289157] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a4b19c5ba806f410a39f069b","created_at":"2026-09-01T10:32:04.401Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cecb8d3a645e1f29b57bd67e00e0b9e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.427Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a4b19c5ba806f410a39f069b: done: 0.033326 sec","job_status":"done","queue_duration_s":2.404345,"scheduling_latency_s":2.404366,"redis_calls":10,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000115,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000727,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00059516,"exclusive_lock_hold_duration_s":0.01222148,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.033326,"completed_at":"2026-09-01T10:32:06.864Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 326.334278] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c8c31afd593ec21920ee8fa3","created_at":"2026-09-01T10:32:04.471Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53a04f619d7d72e040dd8c5c1a8fe78d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.494Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c8c31afd593ec21920ee8fa3: start","job_status":"start","queue_duration_s":2.371415,"scheduling_latency_s":2.371435}1641gitlab # [ 326.348605] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.874Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1642gitlab # [ 326.352075] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.880Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c8c31afd593ec21920ee8fa3","created_at":"2026-09-01T10:32:04.471Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53a04f619d7d72e040dd8c5c1a8fe78d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.494Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c8c31afd593ec21920ee8fa3: done: 0.014408 sec","job_status":"done","queue_duration_s":2.371415,"scheduling_latency_s":2.371435,"redis_calls":8,"redis_duration_s":0.001237,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000129,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000313,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014408,"completed_at":"2026-09-01T10:32:06.880Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 326.393545] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.882Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3133bd2657cce87c6f015cb9","created_at":"2026-09-01T10:32:04.564Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b4776f1a74f6e4e0733d8f8883a1624","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.588Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3133bd2657cce87c6f015cb9: start","job_status":"start","queue_duration_s":2.293471,"scheduling_latency_s":2.293491}1644gitlab # [ 326.407977] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.890Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1645gitlab # [ 326.411515] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3133bd2657cce87c6f015cb9","created_at":"2026-09-01T10:32:04.564Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b4776f1a74f6e4e0733d8f8883a1624","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.588Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3133bd2657cce87c6f015cb9: done: 0.0148 sec","job_status":"done","queue_duration_s":2.293471,"scheduling_latency_s":2.293491,"redis_calls":8,"redis_duration_s":0.001272,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00014,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000331,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0148,"completed_at":"2026-09-01T10:32:06.896Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 326.453311] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"bb381dd93e517faa8949172a","created_at":"2026-09-01T10:32:04.627Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e2bf775b43cc62cf5d684b10517f473","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.651Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-bb381dd93e517faa8949172a: start","job_status":"start","queue_duration_s":2.246821,"scheduling_latency_s":2.24684}1647gitlab # [ 326.467354] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.907Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1648gitlab # [ 326.470629] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"bb381dd93e517faa8949172a","created_at":"2026-09-01T10:32:04.627Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e2bf775b43cc62cf5d684b10517f473","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.651Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-bb381dd93e517faa8949172a: done: 0.015195 sec","job_status":"done","queue_duration_s":2.246821,"scheduling_latency_s":2.24684,"redis_calls":8,"redis_duration_s":0.001279,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00014,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00033,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015195,"completed_at":"2026-09-01T10:32:06.913Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 326.514099] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"d74a35ab5298f6075b0074c5","created_at":"2026-09-01T10:32:04.702Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2d7a28c7140756bf78aa57b2e0e6b03","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.726Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-d74a35ab5298f6075b0074c5: start","job_status":"start","queue_duration_s":2.188553,"scheduling_latency_s":2.188574}1650gitlab # [ 326.528914] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"d74a35ab5298f6075b0074c5","created_at":"2026-09-01T10:32:04.702Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2d7a28c7140756bf78aa57b2e0e6b03","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.726Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-d74a35ab5298f6075b0074c5: done: 0.018959 sec","job_status":"done","queue_duration_s":2.188553,"scheduling_latency_s":2.188574,"redis_calls":10,"redis_duration_s":0.001806,"redis_read_bytes":135,"redis_write_bytes":1227,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000145,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000814,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005757,"exclusive_lock_hold_duration_s":0.00319056,"duration_s":0.018959,"completed_at":"2026-09-01T10:32:06.933Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 326.570792] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.936Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"78dda6da22e240080e1d8ed3","created_at":"2026-09-01T10:32:04.780Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c794b8ba8cdfeed9c226ad96883ff48","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.806Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-78dda6da22e240080e1d8ed3: start","job_status":"start","queue_duration_s":2.130072,"scheduling_latency_s":2.130093}1652gitlab # [ 326.584112] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.951Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"78dda6da22e240080e1d8ed3","created_at":"2026-09-01T10:32:04.780Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c794b8ba8cdfeed9c226ad96883ff48","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.806Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-78dda6da22e240080e1d8ed3: done: 0.015283 sec","job_status":"done","queue_duration_s":2.130072,"scheduling_latency_s":2.130093,"redis_calls":11,"redis_duration_s":0.001713,"redis_read_bytes":138,"redis_write_bytes":877,"redis_cache_calls":3,"redis_cache_duration_s":0.000379,"redis_cache_read_bytes":5,"redis_cache_write_bytes":97,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000166,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000832,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015283,"completed_at":"2026-09-01T10:32:06.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653gitlab # [ 326.627620] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.952Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4aa5af592c026914f05d6cf0","created_at":"2026-09-01T10:32:04.846Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d02679bbe0820709b1d27caa6804fcab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:32:04.873Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4aa5af592c026914f05d6cf0: start","job_status":"start","queue_duration_s":2.079529,"scheduling_latency_s":2.079549}1654gitlab # [ 326.641267] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.961Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1655gitlab # [ 326.645020] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.967Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4aa5af592c026914f05d6cf0","created_at":"2026-09-01T10:32:04.846Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d02679bbe0820709b1d27caa6804fcab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:32:04.873Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4aa5af592c026914f05d6cf0: done: 0.014634 sec","job_status":"done","queue_duration_s":2.079529,"scheduling_latency_s":2.079549,"redis_calls":8,"redis_duration_s":0.001348,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000162,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000347,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014634,"completed_at":"2026-09-01T10:32:06.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 326.686069] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"759d37d31b3bbf323520fbdf","created_at":"2026-09-01T10:32:04.923Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f53856e2e06065b98b3ff3dbf93a9fed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.950Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-759d37d31b3bbf323520fbdf: start","job_status":"start","queue_duration_s":2.017958,"scheduling_latency_s":2.017978}1657gitlab # [ 326.699687] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.995Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"759d37d31b3bbf323520fbdf","created_at":"2026-09-01T10:32:04.923Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-37e25363bfff402e","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f53856e2e06065b98b3ff3dbf93a9fed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:04.950Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-759d37d31b3bbf323520fbdf: done: 0.026295 sec","job_status":"done","queue_duration_s":2.017958,"scheduling_latency_s":2.017978,"redis_calls":16,"redis_duration_s":0.002196,"redis_read_bytes":273,"redis_write_bytes":4225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.00021,"redis_queues_read_bytes":4,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001292,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026295,"completed_at":"2026-09-01T10:32:06.995Z","load_balancing_strategy":"primary","db_duration_s":0.000632,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 326.743768] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:06.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"81dff78c672e06cad82272e1","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-81dff78c672e06cad82272e1: start","job_status":"start","queue_duration_s":0.810921,"scheduling_latency_s":0.81094}1659gitlab # [ 326.756273] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"81dff78c672e06cad82272e1","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-81dff78c672e06cad82272e1: done: 0.039607 sec","job_status":"done","queue_duration_s":0.810921,"scheduling_latency_s":0.81094,"redis_calls":13,"redis_duration_s":0.001944,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002605,"duration_s":0.039607,"completed_at":"2026-09-01T10:32:07.035Z","load_balancing_strategy":"primary","db_duration_s":0.012427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 326.796225] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e47a4d56ba690f4ce203fba3","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e47a4d56ba690f4ce203fba3: start","job_status":"start","queue_duration_s":0.851959,"scheduling_latency_s":0.851981}1661gitlab # [ 326.808189] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e47a4d56ba690f4ce203fba3","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e47a4d56ba690f4ce203fba3: done: 0.021871 sec","job_status":"done","queue_duration_s":0.851959,"scheduling_latency_s":0.851981,"redis_calls":10,"redis_duration_s":0.001702,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021871,"completed_at":"2026-09-01T10:32:07.059Z","load_balancing_strategy":"primary","db_duration_s":0.002934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662gitlab # [ 326.846732] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"be2ee061550fe3c5839c8508","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-be2ee061550fe3c5839c8508: start","job_status":"start","queue_duration_s":0.875168,"scheduling_latency_s":0.875191}1663gitlab # [ 326.859102] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"be2ee061550fe3c5839c8508","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-be2ee061550fe3c5839c8508: done: 0.021423 sec","job_status":"done","queue_duration_s":0.875168,"scheduling_latency_s":0.875191,"redis_calls":10,"redis_duration_s":0.0016589999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021423,"completed_at":"2026-09-01T10:32:07.081Z","load_balancing_strategy":"primary","db_duration_s":0.002634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 326.897917] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0cc61bf46b110f6f1ea24771","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0cc61bf46b110f6f1ea24771: start","job_status":"start","queue_duration_s":0.897847,"scheduling_latency_s":0.897869}1665gitlab # [ 326.911346] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0cc61bf46b110f6f1ea24771","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0cc61bf46b110f6f1ea24771: done: 0.021719 sec","job_status":"done","queue_duration_s":0.897847,"scheduling_latency_s":0.897869,"redis_calls":10,"redis_duration_s":0.001741,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021719,"completed_at":"2026-09-01T10:32:07.104Z","load_balancing_strategy":"primary","db_duration_s":0.002613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 326.949816] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"344c438a100dafce771a08b0","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-344c438a100dafce771a08b0: start","job_status":"start","queue_duration_s":0.920891,"scheduling_latency_s":0.920911}1667gitlab # [ 326.962054] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"344c438a100dafce771a08b0","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-344c438a100dafce771a08b0: done: 0.020127 sec","job_status":"done","queue_duration_s":0.920891,"scheduling_latency_s":0.920911,"redis_calls":10,"redis_duration_s":0.001389,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000815,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020127,"completed_at":"2026-09-01T10:32:07.126Z","load_balancing_strategy":"primary","db_duration_s":0.002581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 327.000357] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c58a87b021b24772e23ff20a","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c58a87b021b24772e23ff20a: start","job_status":"start","queue_duration_s":0.942172,"scheduling_latency_s":0.942192}1669gitlab # [ 327.012494] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c58a87b021b24772e23ff20a","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c58a87b021b24772e23ff20a: done: 0.019154 sec","job_status":"done","queue_duration_s":0.942172,"scheduling_latency_s":0.942192,"redis_calls":10,"redis_duration_s":0.001392,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000814,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019154,"completed_at":"2026-09-01T10:32:07.146Z","load_balancing_strategy":"primary","db_duration_s":0.002253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 327.050924] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f0d80d6a62fb5ea51c9c80f4","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f0d80d6a62fb5ea51c9c80f4: start","job_status":"start","queue_duration_s":0.962472,"scheduling_latency_s":0.962491}1671gitlab # [ 327.063273] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f0d80d6a62fb5ea51c9c80f4","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f0d80d6a62fb5ea51c9c80f4: done: 0.02065 sec","job_status":"done","queue_duration_s":0.962472,"scheduling_latency_s":0.962491,"redis_calls":10,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02065,"completed_at":"2026-09-01T10:32:07.168Z","load_balancing_strategy":"primary","db_duration_s":0.002553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 327.101784] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d65ededa67b7ab3df8770290","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d65ededa67b7ab3df8770290: start","job_status":"start","queue_duration_s":0.984374,"scheduling_latency_s":0.984395}1673gitlab # [ 327.115318] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d65ededa67b7ab3df8770290","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d65ededa67b7ab3df8770290: done: 0.021995 sec","job_status":"done","queue_duration_s":0.984374,"scheduling_latency_s":0.984395,"redis_calls":10,"redis_duration_s":0.0017439999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021995,"completed_at":"2026-09-01T10:32:07.191Z","load_balancing_strategy":"primary","db_duration_s":0.002667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674gitlab # [ 327.154179] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ff48f15d914d569bda9b4986","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ff48f15d914d569bda9b4986: start","job_status":"start","queue_duration_s":1.007981,"scheduling_latency_s":1.00801}1675gitlab # [ 327.166480] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ff48f15d914d569bda9b4986","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ff48f15d914d569bda9b4986: done: 0.054817 sec","job_status":"done","queue_duration_s":1.007981,"scheduling_latency_s":1.00801,"redis_calls":10,"redis_duration_s":0.0023769999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001305,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.026,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.026,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054817,"completed_at":"2026-09-01T10:32:07.248Z","load_balancing_strategy":"primary","db_duration_s":0.003007,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 327.205420] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"624c73a6480cbe28c7d7f7af","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-624c73a6480cbe28c7d7f7af: start","job_status":"start","queue_duration_s":1.064749,"scheduling_latency_s":1.064785}1677gitlab # [ 327.217775] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"624c73a6480cbe28c7d7f7af","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-624c73a6480cbe28c7d7f7af: done: 0.034168 sec","job_status":"done","queue_duration_s":1.064749,"scheduling_latency_s":1.064785,"redis_calls":10,"redis_duration_s":0.0024850000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001435,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034168,"completed_at":"2026-09-01T10:32:07.284Z","load_balancing_strategy":"primary","db_duration_s":0.003447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 327.256475] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c2376575dad6cffc414244b4","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c2376575dad6cffc414244b4: start","job_status":"start","queue_duration_s":1.101143,"scheduling_latency_s":1.101182}1679gitlab # [ 327.268690] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c2376575dad6cffc414244b4","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c2376575dad6cffc414244b4: done: 0.029852 sec","job_status":"done","queue_duration_s":1.101143,"scheduling_latency_s":1.101182,"redis_calls":10,"redis_duration_s":0.001977,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029852,"completed_at":"2026-09-01T10:32:07.316Z","load_balancing_strategy":"primary","db_duration_s":0.003545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 327.306972] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7b7bd9fce0b178afe9404a95","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7b7bd9fce0b178afe9404a95: start","job_status":"start","queue_duration_s":1.132375,"scheduling_latency_s":1.132402}1681gitlab # [ 327.320404] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7b7bd9fce0b178afe9404a95","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7b7bd9fce0b178afe9404a95: done: 0.023287 sec","job_status":"done","queue_duration_s":1.132375,"scheduling_latency_s":1.132402,"redis_calls":10,"redis_duration_s":0.001528,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023287,"completed_at":"2026-09-01T10:32:07.341Z","load_balancing_strategy":"primary","db_duration_s":0.002871,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 327.358662] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6e39d858ea8db84e289a74f8","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6e39d858ea8db84e289a74f8: start","job_status":"start","queue_duration_s":1.157089,"scheduling_latency_s":1.157118}1683gitlab # [ 327.371022] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6e39d858ea8db84e289a74f8","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6e39d858ea8db84e289a74f8: done: 0.025188 sec","job_status":"done","queue_duration_s":1.157089,"scheduling_latency_s":1.157118,"redis_calls":10,"redis_duration_s":0.00162,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025188,"completed_at":"2026-09-01T10:32:07.367Z","load_balancing_strategy":"primary","db_duration_s":0.002825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 327.410006] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"be658c6ae7c79d2d7660f297","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-be658c6ae7c79d2d7660f297: start","job_status":"start","queue_duration_s":1.183844,"scheduling_latency_s":1.183873}1685gitlab # [ 327.422263] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"be658c6ae7c79d2d7660f297","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-be658c6ae7c79d2d7660f297: done: 0.025926 sec","job_status":"done","queue_duration_s":1.183844,"scheduling_latency_s":1.183873,"redis_calls":10,"redis_duration_s":0.001767,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025926,"completed_at":"2026-09-01T10:32:07.395Z","load_balancing_strategy":"primary","db_duration_s":0.002832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 327.460432] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7b7699295466ce0b381aa2c9","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7b7699295466ce0b381aa2c9: start","job_status":"start","queue_duration_s":1.211382,"scheduling_latency_s":1.211411}1687gitlab # [ 327.472601] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7b7699295466ce0b381aa2c9","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7b7699295466ce0b381aa2c9: done: 0.024315 sec","job_status":"done","queue_duration_s":1.211382,"scheduling_latency_s":1.211411,"redis_calls":10,"redis_duration_s":0.001985,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024315,"completed_at":"2026-09-01T10:32:07.421Z","load_balancing_strategy":"primary","db_duration_s":0.002489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688gitlab # [ 327.511000] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2646509c10ac5dbb479084be","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2646509c10ac5dbb479084be: start","job_status":"start","queue_duration_s":1.237116,"scheduling_latency_s":1.237143}1689gitlab # [ 327.524555] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2646509c10ac5dbb479084be","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2646509c10ac5dbb479084be: done: 0.022084 sec","job_status":"done","queue_duration_s":1.237116,"scheduling_latency_s":1.237143,"redis_calls":10,"redis_duration_s":0.001382,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000801,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022084,"completed_at":"2026-09-01T10:32:07.444Z","load_balancing_strategy":"primary","db_duration_s":0.002733,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1690gitlab # [ 327.563113] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"341a5b32a29d6575d290b363","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-341a5b32a29d6575d290b363: start","job_status":"start","queue_duration_s":1.261401,"scheduling_latency_s":1.26142}1691gitlab # [ 327.575411] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"341a5b32a29d6575d290b363","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-341a5b32a29d6575d290b363: done: 0.021489 sec","job_status":"done","queue_duration_s":1.261401,"scheduling_latency_s":1.26142,"redis_calls":10,"redis_duration_s":0.001448,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00084,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021489,"completed_at":"2026-09-01T10:32:07.468Z","load_balancing_strategy":"primary","db_duration_s":0.00272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1692gitlab # [ 327.613647] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9db48fa237c8c5e021950a19","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9db48fa237c8c5e021950a19: start","job_status":"start","queue_duration_s":1.284113,"scheduling_latency_s":1.284132}1693gitlab # [ 327.626041] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9db48fa237c8c5e021950a19","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9db48fa237c8c5e021950a19: done: 0.021683 sec","job_status":"done","queue_duration_s":1.284113,"scheduling_latency_s":1.284132,"redis_calls":10,"redis_duration_s":0.0015639999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021683,"completed_at":"2026-09-01T10:32:07.491Z","load_balancing_strategy":"primary","db_duration_s":0.002459,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1694gitlab # [ 327.664652] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e6b6bf0b1054003d3023a1e1","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e6b6bf0b1054003d3023a1e1: start","job_status":"start","queue_duration_s":1.30704,"scheduling_latency_s":1.30706}1695gitlab # [ 327.676795] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e6b6bf0b1054003d3023a1e1","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e6b6bf0b1054003d3023a1e1: done: 0.023087 sec","job_status":"done","queue_duration_s":1.30704,"scheduling_latency_s":1.30706,"redis_calls":10,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023087,"completed_at":"2026-09-01T10:32:07.515Z","load_balancing_strategy":"primary","db_duration_s":0.002545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696gitlab # [ 327.715215] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a448cc8dc6549ae70f71980d","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a448cc8dc6549ae70f71980d: start","job_status":"start","queue_duration_s":1.331787,"scheduling_latency_s":1.331807}1697gitlab # [ 327.728850] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a448cc8dc6549ae70f71980d","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a448cc8dc6549ae70f71980d: done: 0.021989 sec","job_status":"done","queue_duration_s":1.331787,"scheduling_latency_s":1.331807,"redis_calls":10,"redis_duration_s":0.001603,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021989,"completed_at":"2026-09-01T10:32:07.539Z","load_balancing_strategy":"primary","db_duration_s":0.002902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1698gitlab # [ 327.767411] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"27fb8d12ce06faa3c4a930e7","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-27fb8d12ce06faa3c4a930e7: start","job_status":"start","queue_duration_s":1.355056,"scheduling_latency_s":1.355075}1699gitlab # [ 327.779799] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"27fb8d12ce06faa3c4a930e7","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-27fb8d12ce06faa3c4a930e7: done: 0.02113 sec","job_status":"done","queue_duration_s":1.355056,"scheduling_latency_s":1.355075,"redis_calls":10,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000597,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02113,"completed_at":"2026-09-01T10:32:07.561Z","load_balancing_strategy":"primary","db_duration_s":0.002685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1700gitlab # [ 327.818401] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ffc284fbc70868564ca352df","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ffc284fbc70868564ca352df: start","job_status":"start","queue_duration_s":1.37853,"scheduling_latency_s":1.37855}1701gitlab # [ 327.830547] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ffc284fbc70868564ca352df","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ffc284fbc70868564ca352df: done: 0.02033 sec","job_status":"done","queue_duration_s":1.37853,"scheduling_latency_s":1.37855,"redis_calls":10,"redis_duration_s":0.001447,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0008,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02033,"completed_at":"2026-09-01T10:32:07.584Z","load_balancing_strategy":"primary","db_duration_s":0.002339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1702gitlab # [ 327.868372] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"73696a1583f4f5667a984e51","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-73696a1583f4f5667a984e51: start","job_status":"start","queue_duration_s":1.400078,"scheduling_latency_s":1.400098}1703gitlab # [ 327.880454] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"73696a1583f4f5667a984e51","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-73696a1583f4f5667a984e51: done: 0.020995 sec","job_status":"done","queue_duration_s":1.400078,"scheduling_latency_s":1.400098,"redis_calls":10,"redis_duration_s":0.001548,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00087,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020995,"completed_at":"2026-09-01T10:32:07.606Z","load_balancing_strategy":"primary","db_duration_s":0.002396,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1704gitlab # [ 327.918692] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f43ef382613d8647adbe0048","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f43ef382613d8647adbe0048: start","job_status":"start","queue_duration_s":1.422313,"scheduling_latency_s":1.422334}1705gitlab # [ 327.932086] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f43ef382613d8647adbe0048","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f43ef382613d8647adbe0048: done: 0.023597 sec","job_status":"done","queue_duration_s":1.422313,"scheduling_latency_s":1.422334,"redis_calls":10,"redis_duration_s":0.0018180000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023597,"completed_at":"2026-09-01T10:32:07.631Z","load_balancing_strategy":"primary","db_duration_s":0.00317,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706gitlab # [ 327.970532] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7d29380747cfb66dbd5e918a","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7d29380747cfb66dbd5e918a: start","job_status":"start","queue_duration_s":1.447226,"scheduling_latency_s":1.447249}1707gitlab # [ 327.982803] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7d29380747cfb66dbd5e918a","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7d29380747cfb66dbd5e918a: done: 0.024661 sec","job_status":"done","queue_duration_s":1.447226,"scheduling_latency_s":1.447249,"redis_calls":10,"redis_duration_s":0.0017000000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024661,"completed_at":"2026-09-01T10:32:07.657Z","load_balancing_strategy":"primary","db_duration_s":0.002926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708gitlab # [ 328.021077] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"365328857f8eeb6fc0b25aad","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-365328857f8eeb6fc0b25aad: start","job_status":"start","queue_duration_s":1.473227,"scheduling_latency_s":1.473249}1709gitlab # [ 328.033638] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"365328857f8eeb6fc0b25aad","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-365328857f8eeb6fc0b25aad: done: 0.022209 sec","job_status":"done","queue_duration_s":1.473227,"scheduling_latency_s":1.473249,"redis_calls":10,"redis_duration_s":0.001711,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022209,"completed_at":"2026-09-01T10:32:07.680Z","load_balancing_strategy":"primary","db_duration_s":0.003672,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 328.071756] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.683Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b3e77fc4372c9de60fe43094","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b3e77fc4372c9de60fe43094: start","job_status":"start","queue_duration_s":1.497832,"scheduling_latency_s":1.497855}1711gitlab # [ 328.084125] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b3e77fc4372c9de60fe43094","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b3e77fc4372c9de60fe43094: done: 0.02212 sec","job_status":"done","queue_duration_s":1.497832,"scheduling_latency_s":1.497855,"redis_calls":10,"redis_duration_s":0.00164,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02212,"completed_at":"2026-09-01T10:32:07.705Z","load_balancing_strategy":"primary","db_duration_s":0.003244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712gitlab # [ 328.122793] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1b44901ced907360a8dd6221","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1b44901ced907360a8dd6221: start","job_status":"start","queue_duration_s":1.521139,"scheduling_latency_s":1.521158}1713gitlab # [ 328.136412] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1b44901ced907360a8dd6221","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1b44901ced907360a8dd6221: done: 0.021652 sec","job_status":"done","queue_duration_s":1.521139,"scheduling_latency_s":1.521158,"redis_calls":10,"redis_duration_s":0.001455,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000837,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021652,"completed_at":"2026-09-01T10:32:07.728Z","load_balancing_strategy":"primary","db_duration_s":0.002858,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714gitlab # [ 328.175092] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7de5d3ca582d8b37368a281d","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7de5d3ca582d8b37368a281d: start","job_status":"start","queue_duration_s":1.545055,"scheduling_latency_s":1.545075}1715gitlab # [ 328.187181] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7de5d3ca582d8b37368a281d","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7de5d3ca582d8b37368a281d: done: 0.021845 sec","job_status":"done","queue_duration_s":1.545055,"scheduling_latency_s":1.545075,"redis_calls":10,"redis_duration_s":0.001545,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021845,"completed_at":"2026-09-01T10:32:07.752Z","load_balancing_strategy":"primary","db_duration_s":0.002729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1716gitlab # [ 328.226171] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"81cff63a9250cb8fa2781d1e","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-81cff63a9250cb8fa2781d1e: start","job_status":"start","queue_duration_s":1.568186,"scheduling_latency_s":1.568205}1717gitlab # [ 328.238633] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"81cff63a9250cb8fa2781d1e","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-81cff63a9250cb8fa2781d1e: done: 0.022195 sec","job_status":"done","queue_duration_s":1.568186,"scheduling_latency_s":1.568205,"redis_calls":10,"redis_duration_s":0.001608,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022195,"completed_at":"2026-09-01T10:32:07.775Z","load_balancing_strategy":"primary","db_duration_s":0.002806,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1718gitlab # [ 328.277146] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6f2f80f40db707d1056a6ba4","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6f2f80f40db707d1056a6ba4: start","job_status":"start","queue_duration_s":1.591722,"scheduling_latency_s":1.591744}1719gitlab # [ 328.289401] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6f2f80f40db707d1056a6ba4","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6f2f80f40db707d1056a6ba4: done: 0.024314 sec","job_status":"done","queue_duration_s":1.591722,"scheduling_latency_s":1.591744,"redis_calls":10,"redis_duration_s":0.001711,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024314,"completed_at":"2026-09-01T10:32:07.801Z","load_balancing_strategy":"primary","db_duration_s":0.00318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1720gitlab # [ 328.327944] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"88065220918c38b19730b0b4","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-88065220918c38b19730b0b4: start","job_status":"start","queue_duration_s":1.617369,"scheduling_latency_s":1.617388}1721gitlab # [ 328.341640] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"88065220918c38b19730b0b4","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-88065220918c38b19730b0b4: done: 0.023216 sec","job_status":"done","queue_duration_s":1.617369,"scheduling_latency_s":1.617388,"redis_calls":10,"redis_duration_s":0.0019169999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001194,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023216,"completed_at":"2026-09-01T10:32:07.825Z","load_balancing_strategy":"primary","db_duration_s":0.003044,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1722gitlab # [ 328.380083] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"17c20ea7184f9a16d752e43e","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-17c20ea7184f9a16d752e43e: start","job_status":"start","queue_duration_s":1.641889,"scheduling_latency_s":1.64191}1723gitlab # [ 328.392351] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"17c20ea7184f9a16d752e43e","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-17c20ea7184f9a16d752e43e: done: 0.023055 sec","job_status":"done","queue_duration_s":1.641889,"scheduling_latency_s":1.64191,"redis_calls":10,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023055,"completed_at":"2026-09-01T10:32:07.850Z","load_balancing_strategy":"primary","db_duration_s":0.00318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1724gitlab # [ 328.430955] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8e7a8e3abd7bee4f32b43875","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8e7a8e3abd7bee4f32b43875: start","job_status":"start","queue_duration_s":1.666141,"scheduling_latency_s":1.66616}1725gitlab # [ 328.443379] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8e7a8e3abd7bee4f32b43875","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8e7a8e3abd7bee4f32b43875: done: 0.027727 sec","job_status":"done","queue_duration_s":1.666141,"scheduling_latency_s":1.66616,"redis_calls":10,"redis_duration_s":0.004327,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003331,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027727,"completed_at":"2026-09-01T10:32:07.879Z","load_balancing_strategy":"primary","db_duration_s":0.007577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1726gitlab # [ 328.481860] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3bb12bdb6261e51873a684dc","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3bb12bdb6261e51873a684dc: start","job_status":"start","queue_duration_s":1.695242,"scheduling_latency_s":1.695263}1727gitlab # [ 328.493922] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3bb12bdb6261e51873a684dc","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3bb12bdb6261e51873a684dc: done: 0.024037 sec","job_status":"done","queue_duration_s":1.695242,"scheduling_latency_s":1.695263,"redis_calls":10,"redis_duration_s":0.002365,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024037,"completed_at":"2026-09-01T10:32:07.904Z","load_balancing_strategy":"primary","db_duration_s":0.002192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1728gitlab # [ 328.532360] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c5506fc488b716e3ba1210a9","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c5506fc488b716e3ba1210a9: start","job_status":"start","queue_duration_s":1.72075,"scheduling_latency_s":1.720772}1729gitlab # [ 328.545545] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c5506fc488b716e3ba1210a9","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c5506fc488b716e3ba1210a9: done: 0.023125 sec","job_status":"done","queue_duration_s":1.72075,"scheduling_latency_s":1.720772,"redis_calls":10,"redis_duration_s":0.001673,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023125,"completed_at":"2026-09-01T10:32:07.929Z","load_balancing_strategy":"primary","db_duration_s":0.002883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1730gitlab # [ 328.583448] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"64719a0fd8f7fe893b77f142","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-64719a0fd8f7fe893b77f142: start","job_status":"start","queue_duration_s":1.745171,"scheduling_latency_s":1.745193}1731gitlab # [ 328.595817] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"64719a0fd8f7fe893b77f142","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-64719a0fd8f7fe893b77f142: done: 0.026658 sec","job_status":"done","queue_duration_s":1.745171,"scheduling_latency_s":1.745193,"redis_calls":10,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026658,"completed_at":"2026-09-01T10:32:07.957Z","load_balancing_strategy":"primary","db_duration_s":0.001928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1732gitlab # [ 328.634858] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1637c8f10555cb785060e01a","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1637c8f10555cb785060e01a: start","job_status":"start","queue_duration_s":1.77413,"scheduling_latency_s":1.774151}1733gitlab # [ 328.647086] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1637c8f10555cb785060e01a","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1637c8f10555cb785060e01a: done: 0.020847 sec","job_status":"done","queue_duration_s":1.77413,"scheduling_latency_s":1.774151,"redis_calls":10,"redis_duration_s":0.001471,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000817,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020847,"completed_at":"2026-09-01T10:32:07.980Z","load_balancing_strategy":"primary","db_duration_s":0.002186,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1734gitlab # [ 328.684787] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:07.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"22d388979938dcdf5cd6f3a4","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-22d388979938dcdf5cd6f3a4: start","job_status":"start","queue_duration_s":1.796303,"scheduling_latency_s":1.796324}1735gitlab # [ 328.696788] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"22d388979938dcdf5cd6f3a4","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-22d388979938dcdf5cd6f3a4: done: 0.022356 sec","job_status":"done","queue_duration_s":1.796303,"scheduling_latency_s":1.796324,"redis_calls":10,"redis_duration_s":0.001646,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022356,"completed_at":"2026-09-01T10:32:08.004Z","load_balancing_strategy":"primary","db_duration_s":0.002042,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1736gitlab # [ 328.734611] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1bc926db824796e6b293a993","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1bc926db824796e6b293a993: start","job_status":"start","queue_duration_s":1.820958,"scheduling_latency_s":1.820981}1737gitlab # [ 328.747860] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1bc926db824796e6b293a993","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1bc926db824796e6b293a993: done: 0.022384 sec","job_status":"done","queue_duration_s":1.820958,"scheduling_latency_s":1.820981,"redis_calls":10,"redis_duration_s":0.0019320000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001204,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022384,"completed_at":"2026-09-01T10:32:08.028Z","load_balancing_strategy":"primary","db_duration_s":0.002113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1738gitlab # [ 328.787146] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9a9e1c7ff3ab303a25565815","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9a9e1c7ff3ab303a25565815: start","job_status":"start","queue_duration_s":1.844692,"scheduling_latency_s":1.844715}1739gitlab # [ 328.799621] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9a9e1c7ff3ab303a25565815","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9a9e1c7ff3ab303a25565815: done: 0.022933 sec","job_status":"done","queue_duration_s":1.844692,"scheduling_latency_s":1.844715,"redis_calls":10,"redis_duration_s":0.001728,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022933,"completed_at":"2026-09-01T10:32:08.052Z","load_balancing_strategy":"primary","db_duration_s":0.002209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1740gitlab # [ 328.839273] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5372dd0a9a0fb36550dde432","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5372dd0a9a0fb36550dde432: start","job_status":"start","queue_duration_s":1.868975,"scheduling_latency_s":1.868998}1741gitlab # [ 328.851823] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5372dd0a9a0fb36550dde432","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5372dd0a9a0fb36550dde432: done: 0.021449 sec","job_status":"done","queue_duration_s":1.868975,"scheduling_latency_s":1.868998,"redis_calls":10,"redis_duration_s":0.002133,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001475,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021449,"completed_at":"2026-09-01T10:32:08.075Z","load_balancing_strategy":"primary","db_duration_s":0.002083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1742gitlab # [ 328.890997] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3aa3bbea1a1c0a5f08628d72","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3aa3bbea1a1c0a5f08628d72: start","job_status":"start","queue_duration_s":1.891776,"scheduling_latency_s":1.891797}1743gitlab # [ 328.903476] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3aa3bbea1a1c0a5f08628d72","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3aa3bbea1a1c0a5f08628d72: done: 0.020808 sec","job_status":"done","queue_duration_s":1.891776,"scheduling_latency_s":1.891797,"redis_calls":10,"redis_duration_s":0.001449,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000856,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020808,"completed_at":"2026-09-01T10:32:08.097Z","load_balancing_strategy":"primary","db_duration_s":0.00192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1744gitlab # [ 328.941944] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4f79cad20e9cd9a3fec033f8","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4f79cad20e9cd9a3fec033f8: start","job_status":"start","queue_duration_s":1.913754,"scheduling_latency_s":1.913775}1745gitlab # [ 328.955469] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4f79cad20e9cd9a3fec033f8","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4f79cad20e9cd9a3fec033f8: done: 0.020685 sec","job_status":"done","queue_duration_s":1.913754,"scheduling_latency_s":1.913775,"redis_calls":10,"redis_duration_s":0.001521,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000875,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020685,"completed_at":"2026-09-01T10:32:08.119Z","load_balancing_strategy":"primary","db_duration_s":0.001982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1746gitlab # [ 328.994394] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"190e48a80d2ab3adce8570c9","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-190e48a80d2ab3adce8570c9: start","job_status":"start","queue_duration_s":1.93609,"scheduling_latency_s":1.936113}1747gitlab # [ 329.006703] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"190e48a80d2ab3adce8570c9","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-190e48a80d2ab3adce8570c9: done: 0.022516 sec","job_status":"done","queue_duration_s":1.93609,"scheduling_latency_s":1.936113,"redis_calls":10,"redis_duration_s":0.001607,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000669,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022516,"completed_at":"2026-09-01T10:32:08.143Z","load_balancing_strategy":"primary","db_duration_s":0.002154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1748gitlab # [ 329.045013] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"876fd959a972969c0425e88e","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-876fd959a972969c0425e88e: start","job_status":"start","queue_duration_s":1.960068,"scheduling_latency_s":1.960091}1749gitlab # [ 329.057362] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"876fd959a972969c0425e88e","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-876fd959a972969c0425e88e: done: 0.022759 sec","job_status":"done","queue_duration_s":1.960068,"scheduling_latency_s":1.960091,"redis_calls":10,"redis_duration_s":0.0017270000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022759,"completed_at":"2026-09-01T10:32:08.168Z","load_balancing_strategy":"primary","db_duration_s":0.002239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1750gitlab # [ 329.096249] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7997f125a3d88cb27c009c6c","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7997f125a3d88cb27c009c6c: start","job_status":"start","queue_duration_s":1.984295,"scheduling_latency_s":1.98432}1751gitlab # [ 329.108505] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7997f125a3d88cb27c009c6c","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7997f125a3d88cb27c009c6c: done: 0.022662 sec","job_status":"done","queue_duration_s":1.984295,"scheduling_latency_s":1.98432,"redis_calls":10,"redis_duration_s":0.001784,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022662,"completed_at":"2026-09-01T10:32:08.192Z","load_balancing_strategy":"primary","db_duration_s":0.00211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1752gitlab # [ 329.147195] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0fbdd10102e87628f7b3d135","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0fbdd10102e87628f7b3d135: start","job_status":"start","queue_duration_s":2.010265,"scheduling_latency_s":2.010288}1753gitlab # [ 329.160582] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0fbdd10102e87628f7b3d135","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0fbdd10102e87628f7b3d135: done: 0.026397 sec","job_status":"done","queue_duration_s":2.010265,"scheduling_latency_s":2.010288,"redis_calls":10,"redis_duration_s":0.001794,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026397,"completed_at":"2026-09-01T10:32:08.222Z","load_balancing_strategy":"primary","db_duration_s":0.002695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1754gitlab # [ 329.199450] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"64f0f13dfe8822bd68637220","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-64f0f13dfe8822bd68637220: start","job_status":"start","queue_duration_s":2.038039,"scheduling_latency_s":2.038063}1755gitlab # [ 329.212061] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"64f0f13dfe8822bd68637220","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-64f0f13dfe8822bd68637220: done: 0.020762 sec","job_status":"done","queue_duration_s":2.038039,"scheduling_latency_s":2.038063,"redis_calls":10,"redis_duration_s":0.0013830000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000801,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020762,"completed_at":"2026-09-01T10:32:08.244Z","load_balancing_strategy":"primary","db_duration_s":0.002023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1756gitlab # [ 329.251278] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7606a8cbf987298554d71048","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7606a8cbf987298554d71048: start","job_status":"start","queue_duration_s":2.060581,"scheduling_latency_s":2.060602}1757gitlab # [ 329.263681] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7606a8cbf987298554d71048","created_at":"2026-09-01T10:32:06.087Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-83d7ec2a6133440d","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"e3d82b512dfcbc2af8a21f932bc168b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.185Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7606a8cbf987298554d71048: done: 0.021175 sec","job_status":"done","queue_duration_s":2.060581,"scheduling_latency_s":2.060602,"redis_calls":10,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000668,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000847,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021175,"completed_at":"2026-09-01T10:32:08.267Z","load_balancing_strategy":"primary","db_duration_s":0.002097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1758gitlab # [ 329.302409] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.268Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac73bef1cc72f86ac11dc9b4","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac73bef1cc72f86ac11dc9b4: start","job_status":"start","queue_duration_s":1.913731,"scheduling_latency_s":1.913751}1759gitlab # [ 329.314916] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac73bef1cc72f86ac11dc9b4","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac73bef1cc72f86ac11dc9b4: done: 0.017366 sec","job_status":"done","queue_duration_s":1.913731,"scheduling_latency_s":1.913751,"redis_calls":14,"redis_duration_s":0.001857,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000183,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017366,"completed_at":"2026-09-01T10:32:08.285Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1760gitlab # [ 329.356041] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a021c6b6debbab030d810c3","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a021c6b6debbab030d810c3: start","job_status":"start","queue_duration_s":1.932352,"scheduling_latency_s":1.932371}1761gitlab # [ 329.369587] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a021c6b6debbab030d810c3","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a021c6b6debbab030d810c3: done: 0.016969 sec","job_status":"done","queue_duration_s":1.932352,"scheduling_latency_s":1.932371,"redis_calls":13,"redis_duration_s":0.00177,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016969,"completed_at":"2026-09-01T10:32:08.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1762gitlab # [ 329.408676] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d29ada33aa6530ebe3458229","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d29ada33aa6530ebe3458229: start","job_status":"start","queue_duration_s":1.950938,"scheduling_latency_s":1.950959}1763gitlab # [ 329.421226] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d29ada33aa6530ebe3458229","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d29ada33aa6530ebe3458229: done: 0.01743 sec","job_status":"done","queue_duration_s":1.950938,"scheduling_latency_s":1.950959,"redis_calls":13,"redis_duration_s":0.001743,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01743,"completed_at":"2026-09-01T10:32:08.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1764gitlab # [ 329.460639] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b13fe7859e0ea42661470655","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b13fe7859e0ea42661470655: start","job_status":"start","queue_duration_s":1.969704,"scheduling_latency_s":1.969723}1765gitlab # [ 329.473081] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b13fe7859e0ea42661470655","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b13fe7859e0ea42661470655: done: 0.0159 sec","job_status":"done","queue_duration_s":1.969704,"scheduling_latency_s":1.969723,"redis_calls":13,"redis_duration_s":0.0016419999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000597,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0159,"completed_at":"2026-09-01T10:32:08.340Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1766gitlab # [ 329.512666] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"800bf2361c968b897052dba4","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-800bf2361c968b897052dba4: start","job_status":"start","queue_duration_s":1.986821,"scheduling_latency_s":1.986839}1767gitlab # [ 329.525019] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"800bf2361c968b897052dba4","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-800bf2361c968b897052dba4: done: 0.015647 sec","job_status":"done","queue_duration_s":1.986821,"scheduling_latency_s":1.986839,"redis_calls":13,"redis_duration_s":0.00156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015647,"completed_at":"2026-09-01T10:32:08.357Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1768gitlab # [ 329.565966] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f555d5f67001b38de6519fab","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f555d5f67001b38de6519fab: start","job_status":"start","queue_duration_s":2.003655,"scheduling_latency_s":2.003673}1769gitlab # [ 329.578665] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f555d5f67001b38de6519fab","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f555d5f67001b38de6519fab: done: 0.014685 sec","job_status":"done","queue_duration_s":2.003655,"scheduling_latency_s":2.003673,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014685,"completed_at":"2026-09-01T10:32:08.373Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1770gitlab # [ 329.618171] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"083f746d885c9c9214ea16ed","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-083f746d885c9c9214ea16ed: start","job_status":"start","queue_duration_s":2.019688,"scheduling_latency_s":2.019706}1771gitlab # [ 329.630829] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"083f746d885c9c9214ea16ed","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-083f746d885c9c9214ea16ed: done: 0.014863 sec","job_status":"done","queue_duration_s":2.019688,"scheduling_latency_s":2.019706,"redis_calls":13,"redis_duration_s":0.0014620000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014863,"completed_at":"2026-09-01T10:32:08.389Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1772gitlab # [ 329.671042] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"536d0faddf65008d266fe62a","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-536d0faddf65008d266fe62a: start","job_status":"start","queue_duration_s":2.035707,"scheduling_latency_s":2.035725}1773gitlab # [ 329.683794] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"536d0faddf65008d266fe62a","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-536d0faddf65008d266fe62a: done: 0.015261 sec","job_status":"done","queue_duration_s":2.035707,"scheduling_latency_s":2.035725,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015261,"completed_at":"2026-09-01T10:32:08.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1774gitlab # [ 329.723984] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e1e30acadfff36eb88e6bca","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e1e30acadfff36eb88e6bca: start","job_status":"start","queue_duration_s":2.052155,"scheduling_latency_s":2.052173}1775gitlab # [ 329.736231] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e1e30acadfff36eb88e6bca","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e1e30acadfff36eb88e6bca: done: 0.015619 sec","job_status":"done","queue_duration_s":2.052155,"scheduling_latency_s":2.052173,"redis_calls":13,"redis_duration_s":0.001666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015619,"completed_at":"2026-09-01T10:32:08.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1776gitlab # [ 329.777446] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"374f80ad2284c56fa8b7ebd0","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-374f80ad2284c56fa8b7ebd0: start","job_status":"start","queue_duration_s":2.069386,"scheduling_latency_s":2.069408}1777gitlab # [ 329.790001] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"374f80ad2284c56fa8b7ebd0","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-374f80ad2284c56fa8b7ebd0: done: 0.016134 sec","job_status":"done","queue_duration_s":2.069386,"scheduling_latency_s":2.069408,"redis_calls":13,"redis_duration_s":0.0016550000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016134,"completed_at":"2026-09-01T10:32:08.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1778gitlab # [ 329.829858] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8febf50195674c50e793fba","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8febf50195674c50e793fba: start","job_status":"start","queue_duration_s":2.086704,"scheduling_latency_s":2.086724}1779gitlab # [ 329.842516] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8febf50195674c50e793fba","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8febf50195674c50e793fba: done: 0.016045 sec","job_status":"done","queue_duration_s":2.086704,"scheduling_latency_s":2.086724,"redis_calls":13,"redis_duration_s":0.0016020000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016045,"completed_at":"2026-09-01T10:32:08.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1780gitlab # [ 329.882028] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85a36002fb5c64d612519f1e","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85a36002fb5c64d612519f1e: start","job_status":"start","queue_duration_s":2.103948,"scheduling_latency_s":2.103968}1781gitlab # [ 329.894590] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85a36002fb5c64d612519f1e","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85a36002fb5c64d612519f1e: done: 0.015527 sec","job_status":"done","queue_duration_s":2.103948,"scheduling_latency_s":2.103968,"redis_calls":13,"redis_duration_s":0.001569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015527,"completed_at":"2026-09-01T10:32:08.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1782gitlab # [ 329.934421] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3814cf610fb96e873e7de060","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3814cf610fb96e873e7de060: start","job_status":"start","queue_duration_s":2.120746,"scheduling_latency_s":2.120767}1783gitlab # [ 329.947181] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3814cf610fb96e873e7de060","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3814cf610fb96e873e7de060: done: 0.016951 sec","job_status":"done","queue_duration_s":2.120746,"scheduling_latency_s":2.120767,"redis_calls":13,"redis_duration_s":0.001646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016951,"completed_at":"2026-09-01T10:32:08.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1784gitlab # [ 329.988047] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29499bc28186f7ba22ddc35d","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29499bc28186f7ba22ddc35d: start","job_status":"start","queue_duration_s":2.138943,"scheduling_latency_s":2.138965}1785gitlab # [ 330.000547] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29499bc28186f7ba22ddc35d","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29499bc28186f7ba22ddc35d: done: 0.015345 sec","job_status":"done","queue_duration_s":2.138943,"scheduling_latency_s":2.138965,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015345,"completed_at":"2026-09-01T10:32:08.508Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1786gitlab # [ 330.040381] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebe991054ff6a181d04c784d","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebe991054ff6a181d04c784d: start","job_status":"start","queue_duration_s":2.155683,"scheduling_latency_s":2.15571}1787gitlab # [ 330.052788] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebe991054ff6a181d04c784d","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebe991054ff6a181d04c784d: done: 0.016236 sec","job_status":"done","queue_duration_s":2.155683,"scheduling_latency_s":2.15571,"redis_calls":13,"redis_duration_s":0.0017929999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016236,"completed_at":"2026-09-01T10:32:08.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1788gitlab # [ 330.092639] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83b1935a10b23d6ff08e300b","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83b1935a10b23d6ff08e300b: start","job_status":"start","queue_duration_s":2.173261,"scheduling_latency_s":2.173287}1789gitlab # [ 330.105072] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83b1935a10b23d6ff08e300b","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83b1935a10b23d6ff08e300b: done: 0.016404 sec","job_status":"done","queue_duration_s":2.173261,"scheduling_latency_s":2.173287,"redis_calls":13,"redis_duration_s":0.0015860000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016404,"completed_at":"2026-09-01T10:32:08.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1790gitlab # [ 330.143990] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce0580375653895308fd0d98","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce0580375653895308fd0d98: start","job_status":"start","queue_duration_s":2.191094,"scheduling_latency_s":2.191121}1791gitlab # [ 330.156162] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce0580375653895308fd0d98","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce0580375653895308fd0d98: done: 0.016504 sec","job_status":"done","queue_duration_s":2.191094,"scheduling_latency_s":2.191121,"redis_calls":13,"redis_duration_s":0.001653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016504,"completed_at":"2026-09-01T10:32:08.562Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1792gitlab # [ 330.195617] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2c68015737ea4047b65b7ae","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2c68015737ea4047b65b7ae: start","job_status":"start","queue_duration_s":2.209,"scheduling_latency_s":2.209028}1793gitlab # [ 330.208064] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2c68015737ea4047b65b7ae","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2c68015737ea4047b65b7ae: done: 0.016619 sec","job_status":"done","queue_duration_s":2.209,"scheduling_latency_s":2.209028,"redis_calls":13,"redis_duration_s":0.001689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016619,"completed_at":"2026-09-01T10:32:08.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1794gitlab # [ 330.246525] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76a4f0644659f91cacfc191a","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76a4f0644659f91cacfc191a: start","job_status":"start","queue_duration_s":2.227113,"scheduling_latency_s":2.227144}1795gitlab # [ 330.259297] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76a4f0644659f91cacfc191a","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76a4f0644659f91cacfc191a: done: 0.016399 sec","job_status":"done","queue_duration_s":2.227113,"scheduling_latency_s":2.227144,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016399,"completed_at":"2026-09-01T10:32:08.598Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1796gitlab # [ 330.297861] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a0c17a53319cc7fba85b2fb","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a0c17a53319cc7fba85b2fb: start","job_status":"start","queue_duration_s":2.244905,"scheduling_latency_s":2.244934}1797gitlab # [ 330.310105] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a0c17a53319cc7fba85b2fb","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a0c17a53319cc7fba85b2fb: done: 0.016295 sec","job_status":"done","queue_duration_s":2.244905,"scheduling_latency_s":2.244934,"redis_calls":13,"redis_duration_s":0.001579,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016295,"completed_at":"2026-09-01T10:32:08.615Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1798gitlab # [ 330.348702] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38364957fcd5a8acd539b37f","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38364957fcd5a8acd539b37f: start","job_status":"start","queue_duration_s":2.26259,"scheduling_latency_s":2.262616}1799gitlab # [ 330.360947] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38364957fcd5a8acd539b37f","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38364957fcd5a8acd539b37f: done: 0.015314 sec","job_status":"done","queue_duration_s":2.26259,"scheduling_latency_s":2.262616,"redis_calls":13,"redis_duration_s":0.0016970000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015314,"completed_at":"2026-09-01T10:32:08.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1800gitlab # [ 330.401076] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0744f3c4ee33f86cdb4fb716","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0744f3c4ee33f86cdb4fb716: start","job_status":"start","queue_duration_s":2.279172,"scheduling_latency_s":2.279189}1801gitlab # [ 330.413636] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0744f3c4ee33f86cdb4fb716","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0744f3c4ee33f86cdb4fb716: done: 0.014285 sec","job_status":"done","queue_duration_s":2.279172,"scheduling_latency_s":2.279189,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014285,"completed_at":"2026-09-01T10:32:08.648Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1802gitlab # [ 330.452935] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4adf3cb42ca55d7498093074","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4adf3cb42ca55d7498093074: start","job_status":"start","queue_duration_s":2.294571,"scheduling_latency_s":2.29459}1803gitlab # [ 330.465444] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4adf3cb42ca55d7498093074","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4adf3cb42ca55d7498093074: done: 0.014645 sec","job_status":"done","queue_duration_s":2.294571,"scheduling_latency_s":2.29459,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014645,"completed_at":"2026-09-01T10:32:08.663Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1804gitlab # [ 330.504383] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0f18901a81e15da4bc38701","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0f18901a81e15da4bc38701: start","job_status":"start","queue_duration_s":2.310432,"scheduling_latency_s":2.31045}1805gitlab # [ 330.516538] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0f18901a81e15da4bc38701","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0f18901a81e15da4bc38701: done: 0.014778 sec","job_status":"done","queue_duration_s":2.310432,"scheduling_latency_s":2.31045,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014778,"completed_at":"2026-09-01T10:32:08.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1806gitlab # [ 330.555737] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45c375dd56b3f448b5f0f6f7","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45c375dd56b3f448b5f0f6f7: start","job_status":"start","queue_duration_s":2.326479,"scheduling_latency_s":2.326499}1807gitlab # [ 330.568463] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45c375dd56b3f448b5f0f6f7","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45c375dd56b3f448b5f0f6f7: done: 0.015538 sec","job_status":"done","queue_duration_s":2.326479,"scheduling_latency_s":2.326499,"redis_calls":13,"redis_duration_s":0.0016179999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015538,"completed_at":"2026-09-01T10:32:08.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1808gitlab # [ 330.608924] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"201e6c40bc2b11be782229b8","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-201e6c40bc2b11be782229b8: start","job_status":"start","queue_duration_s":2.343264,"scheduling_latency_s":2.343282}1809gitlab # [ 330.621367] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"201e6c40bc2b11be782229b8","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-201e6c40bc2b11be782229b8: done: 0.01541 sec","job_status":"done","queue_duration_s":2.343264,"scheduling_latency_s":2.343282,"redis_calls":13,"redis_duration_s":0.0017,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01541,"completed_at":"2026-09-01T10:32:08.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1810gitlab # [ 330.660355] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac75a7577d9fc216c2460c2a","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac75a7577d9fc216c2460c2a: start","job_status":"start","queue_duration_s":2.359931,"scheduling_latency_s":2.35995}1811gitlab # [ 330.672589] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac75a7577d9fc216c2460c2a","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac75a7577d9fc216c2460c2a: done: 0.017358 sec","job_status":"done","queue_duration_s":2.359931,"scheduling_latency_s":2.35995,"redis_calls":13,"redis_duration_s":0.002104,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001437,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017358,"completed_at":"2026-09-01T10:32:08.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1812gitlab # [ 330.711733] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fe5b9dc30d6ac8db28e4b80","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fe5b9dc30d6ac8db28e4b80: start","job_status":"start","queue_duration_s":2.378636,"scheduling_latency_s":2.378657}1813gitlab # [ 330.724388] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fe5b9dc30d6ac8db28e4b80","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fe5b9dc30d6ac8db28e4b80: done: 0.015989 sec","job_status":"done","queue_duration_s":2.378636,"scheduling_latency_s":2.378657,"redis_calls":13,"redis_duration_s":0.001641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015989,"completed_at":"2026-09-01T10:32:08.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1814gitlab # [ 330.763462] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2949c8183c59e278976e30c6","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2949c8183c59e278976e30c6: start","job_status":"start","queue_duration_s":2.395819,"scheduling_latency_s":2.395837}1815gitlab # [ 330.776080] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2949c8183c59e278976e30c6","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2949c8183c59e278976e30c6: done: 0.015743 sec","job_status":"done","queue_duration_s":2.395819,"scheduling_latency_s":2.395837,"redis_calls":13,"redis_duration_s":0.001921,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001298,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015743,"completed_at":"2026-09-01T10:32:08.766Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1816gitlab # [ 330.816342] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ffd0b83d951579dbf3806fd","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ffd0b83d951579dbf3806fd: start","job_status":"start","queue_duration_s":2.412801,"scheduling_latency_s":2.412821}1817gitlab # [ 330.828702] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ffd0b83d951579dbf3806fd","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ffd0b83d951579dbf3806fd: done: 0.015967 sec","job_status":"done","queue_duration_s":2.412801,"scheduling_latency_s":2.412821,"redis_calls":13,"redis_duration_s":0.00179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015967,"completed_at":"2026-09-01T10:32:08.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1818gitlab # [ 330.868050] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f25d58e827497463e1bee4c0","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f25d58e827497463e1bee4c0: start","job_status":"start","queue_duration_s":2.430093,"scheduling_latency_s":2.430111}1819gitlab # [ 330.880222] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f25d58e827497463e1bee4c0","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f25d58e827497463e1bee4c0: done: 0.014794 sec","job_status":"done","queue_duration_s":2.430093,"scheduling_latency_s":2.430111,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014794,"completed_at":"2026-09-01T10:32:08.799Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1820gitlab # [ 330.918283] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf23fc04a69bf1613dac4006","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf23fc04a69bf1613dac4006: start","job_status":"start","queue_duration_s":2.446055,"scheduling_latency_s":2.446073}1821gitlab # [ 330.930564] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf23fc04a69bf1613dac4006","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf23fc04a69bf1613dac4006: done: 0.014606 sec","job_status":"done","queue_duration_s":2.446055,"scheduling_latency_s":2.446073,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014606,"completed_at":"2026-09-01T10:32:08.815Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1822gitlab # [ 330.969019] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80147f2b954bdb897c57dfc7","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80147f2b954bdb897c57dfc7: start","job_status":"start","queue_duration_s":2.461826,"scheduling_latency_s":2.461845}1823gitlab # [ 330.981269] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80147f2b954bdb897c57dfc7","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80147f2b954bdb897c57dfc7: done: 0.015171 sec","job_status":"done","queue_duration_s":2.461826,"scheduling_latency_s":2.461845,"redis_calls":13,"redis_duration_s":0.001796,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001244,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015171,"completed_at":"2026-09-01T10:32:08.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1824gitlab # [ 331.020858] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf844288a9b98014bec3975e","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf844288a9b98014bec3975e: start","job_status":"start","queue_duration_s":2.478198,"scheduling_latency_s":2.478218}1825gitlab # [ 331.032928] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf844288a9b98014bec3975e","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf844288a9b98014bec3975e: done: 0.015021 sec","job_status":"done","queue_duration_s":2.478198,"scheduling_latency_s":2.478218,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015021,"completed_at":"2026-09-01T10:32:08.847Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1826gitlab # [ 331.071759] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2e8a79d153ec28c2a45877c","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2e8a79d153ec28c2a45877c: start","job_status":"start","queue_duration_s":2.4948,"scheduling_latency_s":2.494819}1827gitlab # [ 331.084467] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2e8a79d153ec28c2a45877c","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2e8a79d153ec28c2a45877c: done: 0.015334 sec","job_status":"done","queue_duration_s":2.4948,"scheduling_latency_s":2.494819,"redis_calls":13,"redis_duration_s":0.001649,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015334,"completed_at":"2026-09-01T10:32:08.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1828gitlab # [ 331.123501] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1abee9b313c6daedf8a75c57","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1abee9b313c6daedf8a75c57: start","job_status":"start","queue_duration_s":2.51136,"scheduling_latency_s":2.511379}1829gitlab # [ 331.135978] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1abee9b313c6daedf8a75c57","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1abee9b313c6daedf8a75c57: done: 0.015458 sec","job_status":"done","queue_duration_s":2.51136,"scheduling_latency_s":2.511379,"redis_calls":13,"redis_duration_s":0.0019069999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015458,"completed_at":"2026-09-01T10:32:08.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1830gitlab # [ 331.174626] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c321ef6b57e1429c439995f9","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c321ef6b57e1429c439995f9: start","job_status":"start","queue_duration_s":2.528039,"scheduling_latency_s":2.528056}1831gitlab # [ 331.186973] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c321ef6b57e1429c439995f9","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c321ef6b57e1429c439995f9: done: 0.015558 sec","job_status":"done","queue_duration_s":2.528039,"scheduling_latency_s":2.528056,"redis_calls":13,"redis_duration_s":0.001718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015558,"completed_at":"2026-09-01T10:32:08.898Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1832gitlab # [ 331.227059] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0b9c0767f4ae69f12d083f1","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0b9c0767f4ae69f12d083f1: start","job_status":"start","queue_duration_s":2.544839,"scheduling_latency_s":2.544857}1833gitlab # [ 331.239608] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0b9c0767f4ae69f12d083f1","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0b9c0767f4ae69f12d083f1: done: 0.017555 sec","job_status":"done","queue_duration_s":2.544839,"scheduling_latency_s":2.544857,"redis_calls":13,"redis_duration_s":0.001872,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001201,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017555,"completed_at":"2026-09-01T10:32:08.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1834gitlab # [ 331.278863] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf1c97e2def4b4468167f5ab","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf1c97e2def4b4468167f5ab: start","job_status":"start","queue_duration_s":2.563752,"scheduling_latency_s":2.563778}1835gitlab # [ 331.291304] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf1c97e2def4b4468167f5ab","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf1c97e2def4b4468167f5ab: done: 0.016984 sec","job_status":"done","queue_duration_s":2.563752,"scheduling_latency_s":2.563778,"redis_calls":13,"redis_duration_s":0.001959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001333,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016984,"completed_at":"2026-09-01T10:32:08.935Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1836gitlab # [ 331.330355] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2940afa85ea263bdbbc8cfa7","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2940afa85ea263bdbbc8cfa7: start","job_status":"start","queue_duration_s":2.582299,"scheduling_latency_s":2.58232}1837gitlab # [ 331.342991] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2940afa85ea263bdbbc8cfa7","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2940afa85ea263bdbbc8cfa7: done: 0.015544 sec","job_status":"done","queue_duration_s":2.582299,"scheduling_latency_s":2.58232,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015544,"completed_at":"2026-09-01T10:32:08.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1838gitlab # [ 331.382410] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f86b3f361b60b6b73ae7dd46","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f86b3f361b60b6b73ae7dd46: start","job_status":"start","queue_duration_s":2.599015,"scheduling_latency_s":2.599034}1839gitlab # [ 331.394832] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f86b3f361b60b6b73ae7dd46","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f86b3f361b60b6b73ae7dd46: done: 0.014711 sec","job_status":"done","queue_duration_s":2.599015,"scheduling_latency_s":2.599034,"redis_calls":13,"redis_duration_s":0.001471,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014711,"completed_at":"2026-09-01T10:32:08.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1840gitlab # [ 331.435264] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45d768d4076f6efd23966ea7","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45d768d4076f6efd23966ea7: start","job_status":"start","queue_duration_s":2.614855,"scheduling_latency_s":2.614873}1841gitlab # [ 331.448170] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45d768d4076f6efd23966ea7","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45d768d4076f6efd23966ea7: done: 0.014678 sec","job_status":"done","queue_duration_s":2.614855,"scheduling_latency_s":2.614873,"redis_calls":13,"redis_duration_s":0.0014030000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014678,"completed_at":"2026-09-01T10:32:08.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1842gitlab # [ 331.487659] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:08.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8f942dffc6075d9ddb97831","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8f942dffc6075d9ddb97831: start","job_status":"start","queue_duration_s":2.630656,"scheduling_latency_s":2.630675}1843gitlab # [ 331.500368] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8f942dffc6075d9ddb97831","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8f942dffc6075d9ddb97831: done: 0.015037 sec","job_status":"done","queue_duration_s":2.630656,"scheduling_latency_s":2.630675,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015037,"completed_at":"2026-09-01T10:32:09.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1844gitlab # [ 331.540033] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c8a55081b32115dff19d98b","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c8a55081b32115dff19d98b: start","job_status":"start","queue_duration_s":2.646901,"scheduling_latency_s":2.646921}1845gitlab # [ 331.552758] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c8a55081b32115dff19d98b","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c8a55081b32115dff19d98b: done: 0.017933 sec","job_status":"done","queue_duration_s":2.646901,"scheduling_latency_s":2.646921,"redis_calls":13,"redis_duration_s":0.002249,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001629,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017933,"completed_at":"2026-09-01T10:32:09.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1846gitlab # [ 331.591999] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"913343bb2ff86c45be98e1c4","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-913343bb2ff86c45be98e1c4: start","job_status":"start","queue_duration_s":2.666124,"scheduling_latency_s":2.666144}1847gitlab # [ 331.604368] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"913343bb2ff86c45be98e1c4","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-913343bb2ff86c45be98e1c4: done: 0.034284 sec","job_status":"done","queue_duration_s":2.666124,"scheduling_latency_s":2.666144,"redis_calls":13,"redis_duration_s":0.001958,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001252,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034284,"completed_at":"2026-09-01T10:32:09.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1848gitlab # [ 331.644692] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37e571bee3a6e0b93880ef9e","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37e571bee3a6e0b93880ef9e: start","job_status":"start","queue_duration_s":2.701854,"scheduling_latency_s":2.701876}1849gitlab # [ 331.657143] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37e571bee3a6e0b93880ef9e","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37e571bee3a6e0b93880ef9e: done: 0.016545 sec","job_status":"done","queue_duration_s":2.701854,"scheduling_latency_s":2.701876,"redis_calls":13,"redis_duration_s":0.001779,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000655,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016545,"completed_at":"2026-09-01T10:32:09.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1850gitlab # [ 331.696859] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f8f184bd7d98e2601119a19","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f8f184bd7d98e2601119a19: start","job_status":"start","queue_duration_s":2.71974,"scheduling_latency_s":2.719762}1851gitlab # [ 331.709077] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f8f184bd7d98e2601119a19","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f8f184bd7d98e2601119a19: done: 0.016194 sec","job_status":"done","queue_duration_s":2.71974,"scheduling_latency_s":2.719762,"redis_calls":13,"redis_duration_s":0.0018009999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016194,"completed_at":"2026-09-01T10:32:09.090Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1852gitlab # [ 331.748641] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86a146975340d033cc58af8d","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86a146975340d033cc58af8d: start","job_status":"start","queue_duration_s":2.737198,"scheduling_latency_s":2.737219}1853gitlab # [ 331.760827] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86a146975340d033cc58af8d","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86a146975340d033cc58af8d: done: 0.015576 sec","job_status":"done","queue_duration_s":2.737198,"scheduling_latency_s":2.737219,"redis_calls":13,"redis_duration_s":0.001666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000611,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015576,"completed_at":"2026-09-01T10:32:09.107Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1854gitlab # [ 331.799377] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b62fdfb15db3fbe96422ac49","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b62fdfb15db3fbe96422ac49: start","job_status":"start","queue_duration_s":2.754106,"scheduling_latency_s":2.754128}1855gitlab # [ 331.811939] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b62fdfb15db3fbe96422ac49","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b62fdfb15db3fbe96422ac49: done: 0.015352 sec","job_status":"done","queue_duration_s":2.754106,"scheduling_latency_s":2.754128,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015352,"completed_at":"2026-09-01T10:32:09.124Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1856gitlab # [ 331.851125] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce1922780d4d7e7d959a815f","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce1922780d4d7e7d959a815f: start","job_status":"start","queue_duration_s":2.770704,"scheduling_latency_s":2.770724}1857gitlab # [ 331.863298] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce1922780d4d7e7d959a815f","created_at":"2026-09-01T10:32:06.276Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-9fc5a94ce5504b10","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e12571085bcf9de0c47d0c32f244b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.354Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce1922780d4d7e7d959a815f: done: 0.014299 sec","job_status":"done","queue_duration_s":2.770704,"scheduling_latency_s":2.770724,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014299,"completed_at":"2026-09-01T10:32:09.139Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1858gitlab # [ 331.901290] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.140Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8e30461b5d1cfadc9af68b56","created_at":"2026-09-01T10:32:06.979Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-233dd168af5e4242","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f53856e2e06065b98b3ff3dbf93a9fed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.989Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8e30461b5d1cfadc9af68b56: start","job_status":"start","queue_duration_s":2.15123,"scheduling_latency_s":2.151249}1859gitlab # [ 331.913184] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.153Z","message":"No existing merge request to be cleaned up."}1860gitlab # [ 331.914908] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.162Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8e30461b5d1cfadc9af68b56","created_at":"2026-09-01T10:32:06.979Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-233dd168af5e4242","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f53856e2e06065b98b3ff3dbf93a9fed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.989Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8e30461b5d1cfadc9af68b56: done: 0.021239 sec","job_status":"done","queue_duration_s":2.15123,"scheduling_latency_s":2.151249,"redis_calls":11,"redis_duration_s":0.001497,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000125,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000799,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021239,"completed_at":"2026-09-01T10:32:09.162Z","load_balancing_strategy":"primary","db_duration_s":0.002071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1861gitlab # [ 331.953484] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.163Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9c0015718e4f2b4aa694fa34","created_at":"2026-09-01T10:32:06.979Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-233dd168af5e4242","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f53856e2e06065b98b3ff3dbf93a9fed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.989Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9c0015718e4f2b4aa694fa34: start","job_status":"start","queue_duration_s":2.173638,"scheduling_latency_s":2.173657}1862gitlab # [ 331.965391] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.174Z","message":"No existing merge request to be cleaned up."}1863gitlab # [ 331.966948] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.183Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9c0015718e4f2b4aa694fa34","created_at":"2026-09-01T10:32:06.979Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-233dd168af5e4242","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f53856e2e06065b98b3ff3dbf93a9fed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.989Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9c0015718e4f2b4aa694fa34: done: 0.020092 sec","job_status":"done","queue_duration_s":2.173638,"scheduling_latency_s":2.173657,"redis_calls":10,"redis_duration_s":0.001455,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000806,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020092,"completed_at":"2026-09-01T10:32:09.183Z","load_balancing_strategy":"primary","db_duration_s":0.001871,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1864gitlab # [ 332.004263] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.184Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"179a1b50971c36fc14466d67","created_at":"2026-09-01T10:32:06.979Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-233dd168af5e4242","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f53856e2e06065b98b3ff3dbf93a9fed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.989Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-179a1b50971c36fc14466d67: start","job_status":"start","queue_duration_s":2.194967,"scheduling_latency_s":2.194986}1865gitlab # [ 332.016081] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.195Z","message":"No existing merge request to be cleaned up."}1866gitlab # [ 332.017724] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.205Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"179a1b50971c36fc14466d67","created_at":"2026-09-01T10:32:06.979Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-233dd168af5e4242","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f53856e2e06065b98b3ff3dbf93a9fed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.989Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-179a1b50971c36fc14466d67: done: 0.020506 sec","job_status":"done","queue_duration_s":2.194967,"scheduling_latency_s":2.194986,"redis_calls":10,"redis_duration_s":0.001476,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000845,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020506,"completed_at":"2026-09-01T10:32:09.205Z","load_balancing_strategy":"primary","db_duration_s":0.001872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1867gitlab # [ 332.055973] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.206Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f6a4537e4e1c884614a7e15d","created_at":"2026-09-01T10:32:06.979Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-233dd168af5e4242","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f53856e2e06065b98b3ff3dbf93a9fed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.989Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f6a4537e4e1c884614a7e15d: start","job_status":"start","queue_duration_s":2.21669,"scheduling_latency_s":2.21671}1868gitlab # [ 332.068095] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.217Z","message":"No existing merge request to be cleaned up."}1869gitlab # [ 332.069697] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:09.226Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f6a4537e4e1c884614a7e15d","created_at":"2026-09-01T10:32:06.979Z","trace_propagation_headers":{"sentry-trace":"a6c109f9285e48e2ab581fc806d45cb7-233dd168af5e4242","baggage":"sentry-trace_id=a6c109f9285e48e2ab581fc806d45cb7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f53856e2e06065b98b3ff3dbf93a9fed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:06.989Z","job_size_bytes":2,"pid":2060,"sidekiq_tid":"m7ow","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f6a4537e4e1c884614a7e15d: done: 0.020431 sec","job_status":"done","queue_duration_s":2.21669,"scheduling_latency_s":2.21671,"redis_calls":10,"redis_duration_s":0.001493,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020431,"completed_at":"2026-09-01T10:32:09.226Z","load_balancing_strategy":"primary","db_duration_s":0.001973,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1870gitlab # [ 335.019970] postgres[3424]: [3424] ERROR: relation "table_without_models" does not exist1871gitlab # [ 335.020342] postgres[3424]: [3424] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1872gitlab # [ 340.810817] runuser[3066]: pam_unix(runuser:session): session closed for user gitlab1873gitlab # [ 340.812368] setup-gitlab-start[3036]: + systemctl restart gitlab-sidekiq.service1874gitlab # [ 340.859322] systemd[1]: Stopping gitlab-sidekiq.service...1875gitlab # [ 340.862994] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:21.586Z","message":"Shutting down"}1876gitlab # [ 340.867279] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:21.586Z","message":"Scheduler exiting..."}1877gitlab # [ 340.871650] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:21.586Z","message":"Terminating quiet threads for default capsule"}1878gitlab # [ 340.876838] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:21.587Z","message":"Scheduler exiting..."}1879gitlab # [ 341.361480] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:22.088Z","message":"Pausing to allow jobs to finish..."}1880gitlab # [ 343.866122] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:24.592Z","message":"Bye!"}1881gitlab # [ 343.908685] sidekiq-cluster[2060]: {"severity":"INFO","time":"2026-09-01T10:32:24.636Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2060,"worker_id":"sidekiq_0","memwd_rss_bytes":929460224,"retry":0}1882gitlab # [ 344.525028] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1883gitlab # [ 344.525479] systemd[1]: Stopped gitlab-sidekiq.service.1884gitlab # [ 344.525720] systemd[1]: gitlab-sidekiq.service: Consumed 2min 4.347s CPU time over 3min 35.354s wall clock time, 936.9M memory peak, 4.5M read from disk.1885gitlab # [ 344.539011] systemd[1]: Started gitlab-sidekiq.service.1886gitlab # [ 344.544288] setup-gitlab-start[3036]: + mkdir -p /var/lib/secrets1887gitlab # [ 344.548551] setup-gitlab-start[3036]: + echo nixbot-test-token-of-20-chars1888gitlab # [ 344.551451] setup-gitlab-start[3036]: + chmod 644 /var/lib/secrets/gitlab-token1889gitlab # [ 344.555488] setup-gitlab-start[3036]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1890gitlab # [ 345.730340] gitaly[902]: time="2026-09-01T10:32:26.457Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:36.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.456" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891gitlab # [ 345.736606] gitaly[902]: time="2026-09-01T10:32:26.457Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:36.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.456" grpc.time_ms=0.782 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1892gitlab # [ 345.947048] gitaly[902]: time="2026-09-01T10:32:26.674Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:36.223" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.674" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893gitlab # [ 345.964975] gitaly[902]: time="2026-09-01T10:32:26.675Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:36.223" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.674" grpc.time_ms=0.579 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894gitlab # [ 346.033175] gitaly[902]: time="2026-09-01T10:32:26.760Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ diskcache=a67c4ca4-87db-44af-80d8-6f27abfa1e27 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:32:36.240" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.691" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895gitlab # [ 346.053125] gitaly[902]: time="2026-09-01T10:32:26.761Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=37 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=45 command.spawn_token_fork_ms=4 command.system_time_ms=25 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:32:36.240" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.691" grpc.time_ms=69.985 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896gitlab # [ 346.074592] gitaly[902]: time="2026-09-01T10:32:26.790Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:36.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.788" pid=902 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1897gitlab # [ 346.088260] gitaly[902]: time="2026-09-01T10:32:26.790Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:36.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.788" grpc.time_ms=1.908 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1898gitlab # [ 346.100837] gitaly[902]: time="2026-09-01T10:32:26.816Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:32:36.019" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.799" grpc.time_ms=16.817 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1899gitlab # [ 346.213137] gitaly[902]: time="2026-09-01T10:32:26.940Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:36.159" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.940" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1900gitlab # [ 346.243757] gitaly[902]: time="2026-09-01T10:32:26.941Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:36.159" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.940" grpc.time_ms=0.636 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1901gitlab # [ 346.278186] gitaly[902]: time="2026-09-01T10:32:27.005Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ diskcache=8bee585a-19e0-4e11-adf5-5273eccbd273 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:32:36.164" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.944" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1902gitlab # [ 346.299955] gitaly[902]: time="2026-09-01T10:32:27.006Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=38 command.spawn_token_fork_ms=6 command.system_time_ms=18 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:32:36.164" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:26.944" grpc.time_ms=61.524 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1903gitlab # [ 346.321857] gitaly[902]: time="2026-09-01T10:32:27.022Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:37.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:27.021" pid=902 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1904gitlab # [ 346.335517] gitaly[902]: time="2026-09-01T10:32:27.023Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:37.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:27.021" grpc.time_ms=1.316 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905gitlab # [ 346.350614] gitaly[902]: time="2026-09-01T10:32:27.047Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:32:37.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:27.029" grpc.time_ms=17.219 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 346.382460] gitaly[902]: time="2026-09-01T10:32:27.110Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:32:37.089" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:27.109" grpc.time_ms=0.278 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab # [ 346.399102] gitaly[902]: time="2026-09-01T10:32:27.125Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:32:37.103" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:27.124" grpc.time_ms=0.721 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908gitlab # [ 347.371458] gitaly[902]: time="2026-09-01T10:32:28.098Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8DYYZN3S89KV2BEXZ44DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:32:38.059" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:28.080" grpc.time_ms=17.554 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909gitlab # [ 347.786862] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:28 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 32021910gitlab # [ 347.790846] setup-gitlab-start[3036]: + mkdir -p /tmp/test-flake1911gitlab # [ 347.796260] setup-gitlab-start[3036]: + cd /tmp/test-flake1912gitlab # [ 347.797147] setup-gitlab-start[3036]: + git init -b master1913gitlab # [ 347.832841] setup-gitlab-start[3539]: Initialized empty Git repository in /tmp/test-flake/.git/1914gitlab # [ 347.834637] setup-gitlab-start[3036]: + git config user.name test1915gitlab # [ 347.841132] setup-gitlab-start[3036]: + git config user.email test@example.com1916gitlab # [ 347.848245] setup-gitlab-start[3036]: + cat1917gitlab # [ 347.854080] setup-gitlab-start[3036]: + git add flake.nix1918gitlab # [ 347.863040] setup-gitlab-start[3036]: + git commit -m 'initial commit'1919gitlab # [ 347.903809] setup-gitlab-start[3544]: [master (root-commit) 8c7fd6e] initial commit1920gitlab # [ 347.909240] setup-gitlab-start[3544]: 1 file changed, 10 insertions(+)1921gitlab # [ 347.911856] setup-gitlab-start[3544]: create mode 100644 flake.nix1922gitlab # [ 347.914553] setup-gitlab-start[3036]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1923gitlab # [ 347.920274] setup-gitlab-start[3036]: + git push -u origin master1924gitlab # [ 348.044889] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:28 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 721925gitlab # [ 349.043835] gitaly[902]: time="2026-09-01T10:32:29.771Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E2B6BRWRVBAE9GGCSN8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:29.753" grpc.time_ms=17.819 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1926gitlab # [ 349.059761] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:29 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 10111927gitlab # [ 349.446345] gitaly[902]: time="2026-09-01T10:32:30.174Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:32:40.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:30.156" grpc.time_ms=17.215 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928gitlab # [ 349.548489] gitaly[902]: time="2026-09-01T10:32:30.276Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-01T10:33:00.055" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-01T10:32:30.256" grpc.time_ms=19.178 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1929gitlab # [ 349.588170] sidekiq-cluster[3487]: {"severity":"INFO","time":"2026-09-01T10:32:30.245Z","message":"Starting cluster with 1 processes"}1930gitlab # [ 349.617995] gitaly[902]: time="2026-09-01T10:32:30.344Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C duration_ms=356ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/allowed"1931gitlab # [ 349.689318] gitaly[902]: time="2026-09-01T10:32:30.416Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C duration_ms=70ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/pre_receive"1932gitlab # [ 349.698071] gitaly[902]: time="2026-09-01T10:32:30.417Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:29.986" grpc.time_ms=429.944 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1933gitlab # [ 349.742575] gitaly[902]: time="2026-09-01T10:32:30.470Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:30.468" grpc.time_ms=1.852 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1934gitlab # [ 349.795414] gitaly[902]: time="2026-09-01T10:32:30.523Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:30.522" grpc.time_ms=0.962 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1935gitlab # [ 349.878097] gitaly[902]: time="2026-09-01T10:32:30.605Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:30.604" grpc.time_ms=1.12 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1936gitlab # [ 350.039467] gitaly[902]: time="2026-09-01T10:32:30.767Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:32:40.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:30.752" grpc.time_ms=14.292 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 350.096086] gitaly[902]: time="2026-09-01T10:32:30.822Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1433 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-01T10:32:40.004" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:32:30.784" grpc.time_ms=37.645 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab # [ 350.133323] gitaly[902]: time="2026-09-01T10:32:30.854Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C duration_ms=185ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/post_receive"1939gitlab # [ 350.140762] gitaly[902]: time="2026-09-01T10:32:30.855Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:30.667" grpc.time_ms=187.598 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1940gitlab # [ 350.165706] gitaly[902]: time="2026-09-01T10:32:30.868Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C diskcache=f0042fdc-c98c-4205-86f7-dbb768344f78 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:29.895" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1941gitlab # [ 350.185495] systemd[1]: Finished setup-gitlab.service.1942gitlab # [ 350.187414] gitlab-workhorse[817]: time="2026-09-01T10:32:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521943gitlab # [ 350.195145] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:30 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 10681944gitlab # [ 350.199261] setup-gitlab-start[3548]: To http://gitlab/root/test-flake.git1945gitlab # [ 350.200951] setup-gitlab-start[3548]: * [new branch] master -> master1946gitlab # [ 350.202502] setup-gitlab-start[3548]: branch 'master' set up to track 'origin/master'.1947gitlab # [ 350.204333] gitaly[902]: time="2026-09-01T10:32:30.869Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=289 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13072 command.oublock=32 command.real_time_ms=964 command.spawn_token_fork_ms=1 command.system_time_ms=165 command.user_time_ms=124 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:29.895" grpc.time_ms=973.59 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1948gitlab # [ 350.225272] systemd[1]: Starting nixbot CI service...1949gitlab: (finished: waiting for unit setup-gitlab.service, in 350.99 seconds)1950gitlab: waiting for unit nixbot.service1951gitlab # [ 351.727731] nixbot[3646]: {"ts": "2026-09-01T10:32:32.454Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1952gitlab # [ 351.770360] nixbot[3646]: {"ts": "2026-09-01T10:32:32.498Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1953gitlab # [ 351.810983] nixbot[3646]: {"ts": "2026-09-01T10:32:32.538Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1954gitlab # [ 351.818573] nixbot[3646]: {"ts": "2026-09-01T10:32:32.546Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1955gitlab # [ 351.826217] nixbot[3646]: {"ts": "2026-09-01T10:32:32.553Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1956gitlab # [ 351.836115] nixbot[3646]: {"ts": "2026-09-01T10:32:32.563Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1957gitlab # [ 351.842401] nixbot[3646]: {"ts": "2026-09-01T10:32:32.570Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1958gitlab # [ 351.848908] nixbot[3646]: {"ts": "2026-09-01T10:32:32.573Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1959gitlab # [ 351.855149] nixbot[3646]: {"ts": "2026-09-01T10:32:32.582Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1960gitlab # [ 351.861610] nixbot[3646]: {"ts": "2026-09-01T10:32:32.585Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1961gitlab # [ 351.869537] nixbot[3646]: {"ts": "2026-09-01T10:32:32.594Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1962gitlab # [ 351.877297] nixbot[3646]: {"ts": "2026-09-01T10:32:32.605Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1963gitlab # [ 351.883733] nixbot[3646]: {"ts": "2026-09-01T10:32:32.610Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1964gitlab # [ 351.890570] nixbot[3646]: {"ts": "2026-09-01T10:32:32.612Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1965gitlab # [ 351.897579] nixbot[3646]: {"ts": "2026-09-01T10:32:32.618Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1966gitlab # [ 351.903893] nixbot[3646]: {"ts": "2026-09-01T10:32:32.621Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1967gitlab # [ 351.909884] nixbot[3646]: {"ts": "2026-09-01T10:32:32.623Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1968gitlab # [ 351.915692] nixbot[3646]: {"ts": "2026-09-01T10:32:32.625Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1969gitlab # [ 351.921115] nixbot[3646]: {"ts": "2026-09-01T10:32:32.631Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1970gitlab # [ 351.926560] nixbot[3646]: {"ts": "2026-09-01T10:32:32.634Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1971gitlab # [ 351.931974] nixbot[3646]: {"ts": "2026-09-01T10:32:32.636Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1972gitlab # [ 351.936958] nixbot[3646]: {"ts": "2026-09-01T10:32:32.644Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1973gitlab # [ 351.941837] nixbot[3646]: {"ts": "2026-09-01T10:32:32.646Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1974gitlab # [ 351.946462] nixbot[3646]: {"ts": "2026-09-01T10:32:32.649Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1975gitlab # [ 351.950774] nixbot[3646]: {"ts": "2026-09-01T10:32:32.651Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1976gitlab # [ 351.956290] nixbot[3646]: {"ts": "2026-09-01T10:32:32.655Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1977gitlab # [ 351.968851] nixbot[3646]: {"ts": "2026-09-01T10:32:32.658Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1978gitlab # [ 351.972440] nixbot[3646]: {"ts": "2026-09-01T10:32:32.661Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1979gitlab # [ 352.453957] nixbot[3646]: INFO: Started server process [3646]1980gitlab # [ 352.456910] nixbot[3646]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1981gitlab # [ 352.507448] nixbot[3646]: INFO: ::ffff:127.0.0.1:41458 - "GET /health HTTP/1.1" 200 OK1982gitlab # [ 352.516581] systemd[1]: Started nixbot CI service.1983gitlab # [ 352.518821] systemd[1]: Reached target Multi-User System.1984gitlab # [ 352.520275] systemd[1]: Startup finished in 894ms (kernel) + 4.343s (initrd) + 5min 47.281s (userspace) = 5min 52.518s.1985gitlab: (finished: waiting for unit nixbot.service, in 2.11 seconds)1986gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1987gitlab # [ 352.671987] nixbot[3646]: INFO: ::ffff:127.0.0.1:59032 - "GET /health HTTP/1.1" 200 OK1988gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1989subtest: project discovered and webhook registered1990gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1991gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds)1992gitlab # [ 352.834818] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1081993gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1994gitlab # [ 354.000364] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1041995gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds)1996gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1997gitlab # [ 355.160563] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1001998gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds)1999gitlab # [ 355.652653] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:36 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 31872000gitlab # [ 355.661337] nixbot[3646]: {"ts": "2026-09-01T10:32:36.381Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}2001gitlab # [ 355.692354] nixbot[3646]: {"ts": "2026-09-01T10:32:36.420Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}2002gitlab # [ 355.800968] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 992003gitlab # [ 355.807497] nixbot[3646]: {"ts": "2026-09-01T10:32:36.530Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}2004gitlab # [ 355.814491] nixbot[3646]: {"ts": "2026-09-01T10:32:36.534Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}2005gitlab # [ 355.967783] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1552006gitlab # [ 355.974462] nixbot[3646]: {"ts": "2026-09-01T10:32:36.697Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}2007gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks2008gitlab # [ 356.341630] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1152009gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)2010(finished: subtest: project discovered and webhook registered, in 3.67 seconds)2011subtest: push delivers the webhook2012gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master2013gitlab # [ 356.455113] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:37 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4702014gitlab # [ 356.469969] nixbot[3646]: {"ts": "2026-09-01T10:32:37.192Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}2015gitlab # [ 356.512152] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 722016gitlab # [ 356.668353] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1852017gitlab # [ 356.676458] nixbot[3646]: {"ts": "2026-09-01T10:32:37.397Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}2018gitlab # [ 356.763027] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:37 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 892019gitlab # [ 356.770663] nixbot[3646]: {"ts": "2026-09-01T10:32:37.491Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}2020gitlab # [ 356.861242] gitaly[902]: time="2026-09-01T10:32:37.587Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=6 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EAVTFEMYWYPSWT8X76NS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-01T10:33:07.361" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:32:37.562" grpc.time_ms=24.663 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 356.920662] gitaly[902]: time="2026-09-01T10:32:37.648Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EAVTFEMYWYPSWT8X76NS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:33:07.445" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:32:37.646" grpc.time_ms=1.378 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 356.951820] gitaly[902]: time="2026-09-01T10:32:37.675Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EAKY9VZ18MAQ6H1E130W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:37.659" grpc.time_ms=15.915 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2023gitlab # Enumerating objects: 5, done.2024gitlab # [ 356.975646] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 4292025gitlab # Counting objects: 20% (1/5)[ 356.978998] gitaly[902]: time="2026-09-01T10:32:37.697Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=7 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EAVTFEMYWYPSWT8X76NS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-01T10:32:47.002" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:32:37.683" grpc.time_ms=13.765 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026gitlab # Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.2027gitlab # Delta compression using up to 4 threads2028gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.2029gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.2030gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)2031gitlab # [ 357.015323] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2442032gitlab # [ 357.020213] nixbot[3646]: {"ts": "2026-09-01T10:32:37.744Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}2033gitlab # [ 357.119305] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 982034gitlab # [ 357.127466] nixbot[3646]: {"ts": "2026-09-01T10:32:37.848Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}2035gitlab # [ 357.136947] nixbot[3646]: {"ts": "2026-09-01T10:32:37.852Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}2036gitlab # [ 357.257122] gitaly[902]: time="2026-09-01T10:32:37.984Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-01T10:33:07.772" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-01T10:32:37.972" grpc.time_ms=12.003 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037gitlab # [ 357.292985] gitaly[902]: time="2026-09-01T10:32:38.019Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N duration_ms=113ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/allowed"2038gitlab # [ 357.351588] gitaly[902]: time="2026-09-01T10:32:38.079Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N duration_ms=59ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/pre_receive"2039gitlab # [ 357.356804] gitaly[902]: time="2026-09-01T10:32:38.082Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:37.905" grpc.time_ms=176.918 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2040gitlab # [ 357.429831] gitaly[902]: time="2026-09-01T10:32:38.157Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:38.156" grpc.time_ms=0.791 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2041gitlab # [ 357.479641] gitaly[902]: time="2026-09-01T10:32:38.207Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB8926F6VFKXQQAXBEVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.193" grpc.time_ms=14.192 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2042gitlab # [ 357.496934] gitaly[902]: time="2026-09-01T10:32:38.213Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:38.212" grpc.time_ms=0.575 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2043gitlab # [ 357.508698] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 3112044gitlab # [ 357.533037] gitaly[902]: time="2026-09-01T10:32:38.260Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:38.259" grpc.time_ms=0.627 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2045gitlab # [ 357.652737] gitaly[902]: time="2026-09-01T10:32:38.380Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EBJ4W0F88N6S2WS4Y8XC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.366" pid=902 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc2046gitlab # [ 357.671478] gitaly[902]: time="2026-09-01T10:32:38.380Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EBJ4W0F88N6S2WS4Y8XC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.366" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2047gitlab # [ 357.691186] gitlab-workhorse[817]: time="2026-09-01T10:32:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1132048gitlab # [ 357.693716] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1652049gitlab # [ 357.696171] gitaly[902]: time="2026-09-01T10:32:38.381Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EBJ4W0F88N6S2WS4Y8XC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.366" grpc.time_ms=14.806 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2050gitlab # [ 357.714335] gitaly[902]: time="2026-09-01T10:32:38.423Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N duration_ms=128ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/post_receive"2051gitlab # To http://gitlab/root/test-flake.git2052gitlab # [ 357.717790] gitaly[902]: time="2026-09-01T10:32:38.424Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:38.294" grpc.time_ms=129.968 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2053gitlab # 8c7fd6e..096a5e8 [ 357.730452] gitaly[902]: time="2026-09-01T10:32:38.440Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N diskcache=e651171a-f725-40b3-af36-f972d6304de4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:37.819" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2054gitlab # master -> master[ 357.742257] gitlab-workhorse[817]: time="2026-09-01T10:32:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=522055gitlab # 2056gitlab # [ 357.744418] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:38 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7052057gitlab # [ 357.746454] gitaly[902]: time="2026-09-01T10:32:38.440Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=221 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13379 command.oublock=32 command.real_time_ms=613 command.spawn_token_fork_ms=2 command.system_time_ms=111 command.user_time_ms=110 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:37.819" grpc.time_ms=620.287 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2058gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.41 seconds)2059gitlab: must succeed: git -C /tmp/test-flake rev-parse master2060gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)2061gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2062gitlab # [ 357.782784] gitaly[902]: time="2026-09-01T10:32:38.510Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EBQKPAR481ZNB4JHWCEF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.486" pid=902 remote_ip="2001:db8:1::1" request_sha=c26ae0cd827528dec2447f8e62cde2ab2bca7ca3 response_bytes=418 span.kind=server system=grpc2063gitlab # [ 357.795808] gitaly[902]: time="2026-09-01T10:32:38.510Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EBQKPAR481ZNB4JHWCEF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.486" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2064gitlab # [ 357.810944] gitlab-workhorse[817]: time="2026-09-01T10:32:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4182065gitlab # [ 357.813009] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 1242066gitlab # [ 357.815308] gitaly[902]: time="2026-09-01T10:32:38.511Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EBQKPAR481ZNB4JHWCEF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.486" grpc.time_ms=24.696 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2067gitlab # [ 357.867814] nixbot[3646]: INFO: ::ffff:127.0.0.1:59036 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2068gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.11 seconds)2069gitlab # [ 357.980349] gitaly[902]: time="2026-09-01T10:32:38.707Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EBYKY2FATHTT4QRK1AQS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.693" grpc.time_ms=14.305 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2070gitlab # [ 357.999471] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1152071gitlab # [ 358.186653] gitaly[902]: time="2026-09-01T10:32:38.914Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EC29PYS5A6PGY8D42DE3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.893" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2072gitlab # [ 358.218565] gitaly[902]: time="2026-09-01T10:32:38.914Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EC29PYS5A6PGY8D42DE3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.893" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2073gitlab # [ 358.246212] gitlab-workhorse[817]: time="2026-09-01T10:32:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672074gitlab # [ 358.249340] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1872075gitlab # [ 358.252399] gitaly[902]: time="2026-09-01T10:32:38.915Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EC29PYS5A6PGY8D42DE3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:38.893" grpc.time_ms=21.419 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2076gitlab # [ 358.397355] gitaly[902]: time="2026-09-01T10:32:39.125Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8ECANKVDWFBKCPM9M2JTM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:39.105" grpc.time_ms=18.935 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2077gitlab # [ 358.427801] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1292078gitlab # [ 358.561921] gitaly[902]: time="2026-09-01T10:32:39.289Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECEVTMQSRQXYJGXXTEGY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:39.255" pid=902 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc2079gitlab # [ 358.593311] gitaly[902]: time="2026-09-01T10:32:39.289Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=24 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECEVTMQSRQXYJGXXTEGY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:39.255" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2080gitlab # [ 358.626417] gitlab-workhorse[817]: time="2026-09-01T10:32:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2092081gitlab # [ 358.630351] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1592082gitlab # [ 358.634354] gitaly[902]: time="2026-09-01T10:32:39.290Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=24 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECEVTMQSRQXYJGXXTEGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:39.255" grpc.time_ms=34.331 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2083gitlab # [ 358.761843] gitaly[902]: time="2026-09-01T10:32:39.489Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:33:09.086" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:32:39.487" grpc.time_ms=1.54 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 358.830777] gitaly[902]: time="2026-09-01T10:32:39.558Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=589 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-01T10:33:09.138" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:32:39.539" grpc.time_ms=17.96 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2086gitlab # [ 358.870845] gitaly[902]: time="2026-09-01T10:32:39.598Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:32:49.134" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:32:39.585" grpc.time_ms=12.831 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 358.901763] gitaly[902]: time="2026-09-01T10:32:39.625Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:32:49.163" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:32:39.613" grpc.time_ms=11.712 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 358.939539] nixbot[3646]: INFO: ::ffff:127.0.0.1:59044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2089gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.07 seconds)2090gitlab # [ 359.021688] gitaly[902]: time="2026-09-01T10:32:39.748Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:32:49.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:39.747" grpc.time_ms=0.756 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 359.054025] gitaly[902]: time="2026-09-01T10:32:39.778Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:32:49.020" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:32:39.761" grpc.time_ms=16.92 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092gitlab # [ 359.127032] gitaly[902]: time="2026-09-01T10:32:39.854Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:39.851" grpc.time_ms=1.883 pid=902 span.kind=server system=grpc2093gitlab # [ 359.174239] gitaly[902]: time="2026-09-01T10:32:39.902Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:32:39.900" grpc.time_ms=0.978 pid=902 span.kind=server system=grpc2094gitlab # [ 359.203003] gitaly[902]: time="2026-09-01T10:32:39.915Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX diskcache=ad8969c0-9c48-4abb-bdfa-d9e7c373896c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:32:49.041" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:39.782" pid=902 ref=refs/keep-around/8c7fd6ee9407b1749fcdba0806cebdddee349570 remote_ip="2001:db8:1::1" revision=8c7fd6ee9407b1749fcdba0806cebdddee349570 span.kind=server system=grpc username=root2095gitlab # [ 359.228859] gitaly[902]: time="2026-09-01T10:32:39.916Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=127 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5184 command.oublock=8 command.real_time_ms=126 command.spawn_token_fork_ms=2 command.system_time_ms=83 command.user_time_ms=44 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:32:49.041" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:32:39.782" grpc.time_ms=133.774 pid=902 ref=refs/keep-around/8c7fd6ee9407b1749fcdba0806cebdddee349570 remote_ip="2001:db8:1::1" revision=8c7fd6ee9407b1749fcdba0806cebdddee349570 span.kind=server system=grpc username=root2096gitlab # [ 359.256407] gitaly[902]: time="2026-09-01T10:32:39.923Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:33:09.522" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:32:39.922" grpc.time_ms=0.708 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab # [ 359.482617] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 8432098gitlab # [ 359.490639] nixbot[3646]: {"ts": "2026-09-01T10:32:40.212Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 \"HTTP/1.1 201 Created\""}2099gitlab # [ 359.505384] nixbot[3646]: {"ts": "2026-09-01T10:32:40.233Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-8c7fd6ee9407-0"}2100gitlab # [ 359.820808] nixbot[3646]: {"ts": "2026-09-01T10:32:40.548Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-8c7fd6ee9407-0", "argv0": "bwrap"}2101gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2102gitlab # [ 360.000543] systemd[1]: Started Nix Daemon.2103gitlab # [ 360.006081] nixbot[3646]: INFO: ::ffff:127.0.0.1:59058 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2104gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2105gitlab # [ 360.118910] nix-daemon[3886]: accepted connection from pid 3878, user nixbot2106gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2107gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2108gitlab # [ 361.062702] nixbot[3646]: INFO: ::ffff:127.0.0.1:52296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2109gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2110gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2111gitlab # [ 362.117670] nixbot[3646]: INFO: ::ffff:127.0.0.1:52310 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2112gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2113gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2114gitlab # [ 363.173001] nixbot[3646]: INFO: ::ffff:127.0.0.1:52312 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2115gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2116gitlab # [ 364.228435] nixbot[3646]: INFO: ::ffff:127.0.0.1:52316 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2117gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2118gitlab # [ 365.016653] nix-daemon[3886]: accepted connection from pid 3913, user nixbot2119gitlab # [ 365.039183] nix-daemon[3886]: accepted connection from pid 3878, user nixbot2120gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2121gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2122gitlab # [ 365.283778] nixbot[3646]: INFO: ::ffff:127.0.0.1:52328 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2123gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2124gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2125gitlab # [ 366.337277] nixbot[3646]: INFO: ::ffff:127.0.0.1:52336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2126gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2127gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2128gitlab # [ 367.390225] nixbot[3646]: INFO: ::ffff:127.0.0.1:52348 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2129gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2130gitlab # [ 368.443826] nixbot[3646]: INFO: ::ffff:127.0.0.1:52354 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2131gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2132gitlab # [ 369.427247] nix-daemon[3886]: accepted connection from pid 3878, user nixbot2133gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2134gitlab # [ 369.510359] nixbot[3646]: INFO: ::ffff:127.0.0.1:52366 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2135gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.07 seconds)2136gitlab # [ 369.652469] gitaly[902]: time="2026-09-01T10:32:50.379Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EQAVQ2W2QY2GKPXRKN77 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:33:20.176" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:32:50.377" grpc.time_ms=1.231 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 369.871165] gitaly[902]: time="2026-09-01T10:32:50.598Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EQAVQ2W2QY2GKPXRKN77 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:33:00.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:32:50.583" grpc.time_ms=15.521 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 370.087980] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 5462139gitlab # [ 370.095916] nixbot[3646]: {"ts": "2026-09-01T10:32:50.816Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 \"HTTP/1.1 201 Created\""}2140gitlab # [ 370.313345] gitaly[902]: time="2026-09-01T10:32:51.041Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EQW5H9P8C7XJRJX45CGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:33:21.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:32:51.039" grpc.time_ms=1.187 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 370.372948] gitaly[902]: time="2026-09-01T10:32:51.100Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EQW5H9P8C7XJRJX45CGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:33:01.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:32:51.082" grpc.time_ms=17.717 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 370.437651] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3432143gitlab # [ 370.440316] nixbot[3646]: {"ts": "2026-09-01T10:32:51.167Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 \"HTTP/1.1 201 Created\""}2144gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2145gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2146gitlab # [ 370.566567] nixbot[3646]: INFO: ::ffff:127.0.0.1:52376 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2147gitlab # [ 370.582428] gitaly[902]: time="2026-09-01T10:32:51.310Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ER7EXP0XCB07ABE17MRN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:33:21.007" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:32:51.308" grpc.time_ms=1.189 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 370.669620] gitaly[902]: time="2026-09-01T10:32:51.396Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8ER7EXP0XCB07ABE17MRN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:33:01.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:32:51.377" grpc.time_ms=18.236 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 370.775760] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3202150gitlab # [ 370.783759] nixbot[3646]: {"ts": "2026-09-01T10:32:51.505Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 \"HTTP/1.1 201 Created\""}2151gitlab # [ 371.159345] gitaly[902]: time="2026-09-01T10:32:51.887Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8ERSVXX8VGPX3Q0Z8YZRE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:51.868" grpc.time_ms=18.588 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2152gitlab # [ 371.199070] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1152153gitlab # [ 371.266614] gitaly[902]: time="2026-09-01T10:32:51.994Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ERXJQAA6FQJ5HCW2FDNY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:51.974" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2154gitlab # [ 371.295827] gitaly[902]: time="2026-09-01T10:32:51.994Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ERXJQAA6FQJ5HCW2FDNY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:51.974" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2155gitlab # [ 371.321891] gitlab-workhorse[817]: time="2026-09-01T10:32:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672156gitlab # [ 371.325064] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:32:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1052157gitlab # [ 371.328423] gitaly[902]: time="2026-09-01T10:32:51.995Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ERXJQAA6FQJ5HCW2FDNY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:32:51.974" grpc.time_ms=20.408 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2158gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2159gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2160gitlab # [ 371.621870] nixbot[3646]: INFO: ::ffff:127.0.0.1:53308 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2161gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2162gitlab # [ 372.678223] nixbot[3646]: INFO: ::ffff:127.0.0.1:53318 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2163gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2164gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2165gitlab # [ 373.735556] nixbot[3646]: INFO: ::ffff:127.0.0.1:53326 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2166gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2167gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2168gitlab # [ 374.792483] nixbot[3646]: INFO: ::ffff:127.0.0.1:53336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2169gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2170gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2171gitlab # [ 375.850067] nixbot[3646]: INFO: ::ffff:127.0.0.1:53342 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2172gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2173gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2174gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2175gitlab # [ 376.905835] nixbot[3646]: INFO: ::ffff:127.0.0.1:53356 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2176gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2177gitlab # [ 377.960424] nixbot[3646]: INFO: ::ffff:127.0.0.1:53368 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2178gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2179gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2180gitlab # [ 379.016093] nixbot[3646]: INFO: ::ffff:127.0.0.1:53382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2181gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2182gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2183gitlab # [ 380.073327] nixbot[3646]: INFO: ::ffff:127.0.0.1:53398 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2184gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2185gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2186gitlab # [ 381.129762] nixbot[3646]: INFO: ::ffff:127.0.0.1:47038 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2187gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2188gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2189gitlab # [ 382.185787] nixbot[3646]: INFO: ::ffff:127.0.0.1:47048 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2190gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2191gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2192gitlab # [ 383.242582] nixbot[3646]: INFO: ::ffff:127.0.0.1:47054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2193gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2194gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2195gitlab # [ 384.298920] nixbot[3646]: INFO: ::ffff:127.0.0.1:47060 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2196gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2197gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2198gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2199gitlab # [ 385.355587] nixbot[3646]: INFO: ::ffff:127.0.0.1:47072 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2200gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2201gitlab # [ 386.409971] nixbot[3646]: INFO: ::ffff:127.0.0.1:47082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2202gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2203gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2204gitlab # [ 387.467646] nixbot[3646]: INFO: ::ffff:127.0.0.1:47088 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2205gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2206gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2207gitlab # [ 388.523643] nixbot[3646]: INFO: ::ffff:127.0.0.1:47102 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2208gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2209gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2210gitlab # [ 389.579606] nixbot[3646]: INFO: ::ffff:127.0.0.1:47112 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2211gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2212gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2213gitlab # [ 390.622238] nixbot[3646]: INFO: ::ffff:127.0.0.1:47128 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2214gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.04 seconds)2215gitlab # [ 390.878430] sidekiq-cluster[3596]: 2026-09-01T10:33:11.604Z pid=3596 tid=y3o INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3596, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430903296}2216gitlab # [ 391.175356] sidekiq-cluster[3596]: W, [2026-09-01T10:33:11.903015 #3596] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2217gitlab # [ 391.241963] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:33:11.969Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2218gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2219gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2220gitlab # [ 391.677729] nixbot[3646]: INFO: ::ffff:127.0.0.1:47502 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2221gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2222gitlab # [ 392.732910] nixbot[3646]: INFO: ::ffff:127.0.0.1:47504 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2223gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2224gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2225gitlab # [ 393.789119] nixbot[3646]: INFO: ::ffff:127.0.0.1:47518 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2226gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2227gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2228gitlab # [ 394.845565] nixbot[3646]: INFO: ::ffff:127.0.0.1:47520 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2229gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2230gitlab # [ 394.859606] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:33:15.586Z","message":"GitLab reliable fetch activated!"}2231gitlab # [ 394.864615] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:33:15.586Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2232gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2233gitlab # [ 395.903481] nixbot[3646]: INFO: ::ffff:127.0.0.1:47524 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2234gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2235gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2236gitlab # [ 396.958616] nixbot[3646]: INFO: ::ffff:127.0.0.1:47536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2237gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2238gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2239gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2240gitlab # [ 398.014184] nixbot[3646]: INFO: ::ffff:127.0.0.1:47544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2241gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2242gitlab # [ 399.069557] nixbot[3646]: INFO: ::ffff:127.0.0.1:47558 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2243gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2244gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2245gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2246gitlab # [ 400.125491] nixbot[3646]: INFO: ::ffff:127.0.0.1:47562 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2247gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2248gitlab # [ 401.180219] nixbot[3646]: INFO: ::ffff:127.0.0.1:43550 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2249gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2250gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2251gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2252gitlab # [ 402.235920] nixbot[3646]: INFO: ::ffff:127.0.0.1:43560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2253gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2254gitlab # [ 403.290829] nixbot[3646]: INFO: ::ffff:127.0.0.1:43572 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2255gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2256gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2257gitlab # [ 404.347065] nixbot[3646]: INFO: ::ffff:127.0.0.1:43576 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2258gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2259gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2260gitlab # [ 405.403032] nixbot[3646]: INFO: ::ffff:127.0.0.1:43584 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2261gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2262gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2263gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2264gitlab # [ 406.458681] nixbot[3646]: INFO: ::ffff:127.0.0.1:43594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2265gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2266gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2267gitlab # [ 407.512505] nixbot[3646]: INFO: ::ffff:127.0.0.1:43606 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2268gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2269gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2270gitlab # [ 408.565371] nixbot[3646]: INFO: ::ffff:127.0.0.1:43616 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2271gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2272gitlab # [ 409.619205] nixbot[3646]: INFO: ::ffff:127.0.0.1:43624 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2273gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2274gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2275gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2276gitlab # [ 410.674806] nixbot[3646]: INFO: ::ffff:127.0.0.1:43632 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2277gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2278gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2279gitlab # [ 411.729015] nixbot[3646]: INFO: ::ffff:127.0.0.1:48360 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2280gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2281gitlab # [ 412.783375] nixbot[3646]: INFO: ::ffff:127.0.0.1:48362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2282gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2283gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2284gitlab # [ 413.839482] nixbot[3646]: INFO: ::ffff:127.0.0.1:48378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2285gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2286gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2287gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2288gitlab # [ 414.896154] nixbot[3646]: INFO: ::ffff:127.0.0.1:48382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2289gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2290gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2291gitlab # [ 415.950952] nixbot[3646]: INFO: ::ffff:127.0.0.1:48386 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2292gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2293gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2294gitlab # [ 417.004956] nixbot[3646]: INFO: ::ffff:127.0.0.1:48394 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2295gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2296gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2297gitlab # [ 418.058838] nixbot[3646]: INFO: ::ffff:127.0.0.1:48410 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2298gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2299gitlab # [ 419.111960] nixbot[3646]: INFO: ::ffff:127.0.0.1:48424 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2300gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2301gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2302gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2303gitlab # [ 420.167246] nixbot[3646]: INFO: ::ffff:127.0.0.1:48438 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2304gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2305gitlab # [ 421.224203] nixbot[3646]: INFO: ::ffff:127.0.0.1:37166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2306gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2307gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2308gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2309gitlab # [ 422.281100] nixbot[3646]: INFO: ::ffff:127.0.0.1:37182 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2310gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2311gitlab # [ 423.334385] nixbot[3646]: INFO: ::ffff:127.0.0.1:37196 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2312gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2313gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2314gitlab # [ 424.391024] nixbot[3646]: INFO: ::ffff:127.0.0.1:37208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2315gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2316gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2317gitlab # [ 425.447712] nixbot[3646]: INFO: ::ffff:127.0.0.1:37224 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2318gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2319gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2320gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2321gitlab # [ 426.504121] nixbot[3646]: INFO: ::ffff:127.0.0.1:37240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2322gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2323gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2324gitlab # [ 427.559176] nixbot[3646]: INFO: ::ffff:127.0.0.1:37252 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2325gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2326gitlab # [ 428.612963] nixbot[3646]: INFO: ::ffff:127.0.0.1:37264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2327gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2328gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2329gitlab # [ 429.668706] nixbot[3646]: INFO: ::ffff:127.0.0.1:37280 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2330gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2331gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2332gitlab # [ 430.730056] nixbot[3646]: INFO: ::ffff:127.0.0.1:37294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2333gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2334gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2335gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2336gitlab # [ 431.791745] nixbot[3646]: INFO: ::ffff:127.0.0.1:48042 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2337gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2338gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2339gitlab # [ 432.853001] nixbot[3646]: INFO: ::ffff:127.0.0.1:48046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2340gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2341gitlab # [ 433.907278] nixbot[3646]: INFO: ::ffff:127.0.0.1:48058 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2342gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2343gitlab # [ 434.096791] postgres[4180]: [4180] ERROR: relation "table_without_models" does not exist2344gitlab # [ 434.100278] postgres[4180]: [4180] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2345gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2346gitlab # [ 434.966127] nixbot[3646]: INFO: ::ffff:127.0.0.1:48064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2347gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2348gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2349gitlab # [ 436.028293] nixbot[3646]: INFO: ::ffff:127.0.0.1:48068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2350gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2351gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2352gitlab # [ 437.089632] nixbot[3646]: INFO: ::ffff:127.0.0.1:48076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2353gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2354gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2355gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2356gitlab # [ 438.150975] nixbot[3646]: INFO: ::ffff:127.0.0.1:48082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2357gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2358gitlab # [ 439.185319] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:33:59.912Z","message":"Booted Rails 7.2.3.1 application in production environment"}2359gitlab # [ 439.188664] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:33:59.916Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2360gitlab # [ 439.192259] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:33:59.918Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2361gitlab # [ 439.197959] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:33:59.918Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2362gitlab # [ 439.204225] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:33:59.920Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2363gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2364gitlab # [ 439.216436] nixbot[3646]: INFO: ::ffff:127.0.0.1:48088 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2365gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2366gitlab # [ 440.267224] nixbot[3646]: INFO: ::ffff:127.0.0.1:48092 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2367gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2368gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2369gitlab # [ 441.324292] nixbot[3646]: INFO: ::ffff:127.0.0.1:60768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2370gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2371gitlab # [ 441.938225] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:02.664Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"00588c54a5a5a24157080432","created_at":"2026-09-01T10:32:26.838Z","trace_propagation_headers":{"sentry-trace":"8915b1601a924641b8f5aa6f65eb26da-b3d6c667b33147e2","baggage":"sentry-trace_id=8915b1601a924641b8f5aa6f65eb26da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8DYYZN3S89KV2BEXZ44DZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:26.903Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-00588c54a5a5a24157080432: start","job_status":"start","queue_duration_s":95.760926,"scheduling_latency_s":95.760986}2372gitlab # [ 442.195469] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:02.922Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"00588c54a5a5a24157080432","created_at":"2026-09-01T10:32:26.838Z","trace_propagation_headers":{"sentry-trace":"8915b1601a924641b8f5aa6f65eb26da-b3d6c667b33147e2","baggage":"sentry-trace_id=8915b1601a924641b8f5aa6f65eb26da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8DYYZN3S89KV2BEXZ44DZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:26.903Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-00588c54a5a5a24157080432: done: 0.257967 sec","job_status":"done","queue_duration_s":95.760926,"scheduling_latency_s":95.760986,"redis_calls":23,"redis_duration_s":0.007323,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.003636,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002086,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1469091,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.257967,"completed_at":"2026-09-01T10:34:02.922Z","load_balancing_strategy":"primary","db_duration_s":0.097013,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2373gitlab # [ 442.287696] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:02.924Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f555158166713e8e71c523f0","created_at":"2026-09-01T10:32:26.923Z","trace_propagation_headers":{"sentry-trace":"8915b1601a924641b8f5aa6f65eb26da-b3d6c667b33147e2","baggage":"sentry-trace_id=8915b1601a924641b8f5aa6f65eb26da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8DYYZN3S89KV2BEXZ44DZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:26.932Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f555158166713e8e71c523f0: start","job_status":"start","queue_duration_s":95.992505,"scheduling_latency_s":95.992539}2374gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2375gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2376gitlab # [ 442.361973] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:03.088Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f555158166713e8e71c523f0","created_at":"2026-09-01T10:32:26.923Z","trace_propagation_headers":{"sentry-trace":"8915b1601a924641b8f5aa6f65eb26da-b3d6c667b33147e2","baggage":"sentry-trace_id=8915b1601a924641b8f5aa6f65eb26da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8DYYZN3S89KV2BEXZ44DZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:26.932Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f555158166713e8e71c523f0: done: 0.164142 sec","job_status":"done","queue_duration_s":95.992505,"scheduling_latency_s":95.992539,"redis_calls":14,"redis_duration_s":0.005249,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000782,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00272,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12228682,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.164142,"completed_at":"2026-09-01T10:34:03.088Z","load_balancing_strategy":"primary","db_duration_s":0.034971,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2377gitlab # [ 442.463612] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:03.094Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6456dd896a2b73fd7776b329","created_at":"2026-09-01T10:32:27.894Z","trace_propagation_headers":{"sentry-trace":"8915b1601a924641b8f5aa6f65eb26da-b3d6c667b33147e2","baggage":"sentry-trace_id=8915b1601a924641b8f5aa6f65eb26da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8DYYZN3S89KV2BEXZ44DZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:27.904Z","job_size_bytes":5,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6456dd896a2b73fd7776b329: start","job_status":"start","queue_duration_s":95.189932,"scheduling_latency_s":95.189972}2378gitlab # [ 442.485603] nixbot[3646]: INFO: ::ffff:127.0.0.1:60784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2379gitlab # [ 442.658089] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:03.385Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6456dd896a2b73fd7776b329","created_at":"2026-09-01T10:32:27.894Z","trace_propagation_headers":{"sentry-trace":"8915b1601a924641b8f5aa6f65eb26da-b3d6c667b33147e2","baggage":"sentry-trace_id=8915b1601a924641b8f5aa6f65eb26da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8DYYZN3S89KV2BEXZ44DZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:27.904Z","job_size_bytes":5,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6456dd896a2b73fd7776b329: done: 0.290993 sec","job_status":"done","queue_duration_s":95.189932,"scheduling_latency_s":95.189972,"redis_calls":12,"redis_duration_s":0.004891,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001981,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002334,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000576,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.232098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041216,"duration_s":0.290993,"completed_at":"2026-09-01T10:34:03.385Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050202,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2380gitlab # [ 442.766712] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:03.387Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"191d4a5d801143e7db7df77e","created_at":"2026-09-01T10:32:27.951Z","trace_propagation_headers":{"sentry-trace":"8915b1601a924641b8f5aa6f65eb26da-b3d6c667b33147e2","baggage":"sentry-trace_id=8915b1601a924641b8f5aa6f65eb26da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8DYYZN3S89KV2BEXZ44DZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:27.960Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-191d4a5d801143e7db7df77e: start","job_status":"start","queue_duration_s":95.427397,"scheduling_latency_s":95.427431}2381gitlab # [ 442.981552] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:03.707Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"191d4a5d801143e7db7df77e","created_at":"2026-09-01T10:32:27.951Z","trace_propagation_headers":{"sentry-trace":"8915b1601a924641b8f5aa6f65eb26da-b3d6c667b33147e2","baggage":"sentry-trace_id=8915b1601a924641b8f5aa6f65eb26da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8DYYZN3S89KV2BEXZ44DZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:27.960Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-191d4a5d801143e7db7df77e: done: 0.319837 sec","job_status":"done","queue_duration_s":95.427397,"scheduling_latency_s":95.427431,"redis_calls":11,"redis_duration_s":0.003607,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000956,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001982,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.266,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.266,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00074272,"duration_s":0.319837,"completed_at":"2026-09-01T10:34:03.707Z","load_balancing_strategy":"primary","db_duration_s":0.120212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 443.088775] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:03.710Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"edec17e02e7883e674c8051a","created_at":"2026-09-01T10:32:27.964Z","trace_propagation_headers":{"sentry-trace":"8915b1601a924641b8f5aa6f65eb26da-b3d6c667b33147e2","baggage":"sentry-trace_id=8915b1601a924641b8f5aa6f65eb26da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8DYYZN3S89KV2BEXZ44DZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:27.972Z","job_size_bytes":89,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-edec17e02e7883e674c8051a: start","job_status":"start","queue_duration_s":95.737729,"scheduling_latency_s":95.73776}2383gitlab # [ 443.111819] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:03.763Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"edec17e02e7883e674c8051a","created_at":"2026-09-01T10:32:27.964Z","trace_propagation_headers":{"sentry-trace":"8915b1601a924641b8f5aa6f65eb26da-b3d6c667b33147e2","baggage":"sentry-trace_id=8915b1601a924641b8f5aa6f65eb26da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8DYYZN3S89KV2BEXZ44DZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:27.972Z","job_size_bytes":89,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-edec17e02e7883e674c8051a: done: 0.053689 sec","job_status":"done","queue_duration_s":95.737729,"scheduling_latency_s":95.73776,"redis_calls":11,"redis_duration_s":0.003432,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000831,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001886,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058376,"duration_s":0.053689,"completed_at":"2026-09-01T10:34:03.763Z","load_balancing_strategy":"primary","db_duration_s":0.00992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 443.165830] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:03.766Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 8c7fd6ee9407b1749fcdba0806cebdddee349570 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0e2c5c564d1a941760ae0d08","created_at":"2026-09-01T10:32:30.725Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-352d944d58aa4ed4","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:30.733Z","job_size_bytes":185,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0e2c5c564d1a941760ae0d08: start","job_status":"start","queue_duration_s":93.033196,"scheduling_latency_s":93.033227}2385gitlab # [ 443.183802] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:03.790Z","message":"changes: \"0000000000000000000000000000000000000000 8c7fd6ee9407b1749fcdba0806cebdddee349570 refs/heads/master\\n\""}2386gitlab # [ 443.186668] gitaly[902]: time="2026-09-01T10:34:03.841Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:13.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:03.824" grpc.time_ms=17.381 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2387gitlab # [ 443.199879] gitaly[902]: time="2026-09-01T10:34:03.869Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:34:13.031" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:34:03.852" grpc.time_ms=16.955 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2388gitlab # [ 443.231561] gitaly[902]: time="2026-09-01T10:34:03.959Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-01T10:34:13.120" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:03.940" grpc.time_ms=18.372 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2389gitlab # [ 443.318108] gitaly[902]: time="2026-09-01T10:34:04.045Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:34:04.044" grpc.time_ms=1.649 pid=902 span.kind=server system=grpc2390gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2391gitlab # [ 443.368744] gitaly[902]: time="2026-09-01T10:34:04.096Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:34:04.094" grpc.time_ms=1.352 pid=902 span.kind=server system=grpc2392gitlab # [ 443.397458] gitaly[902]: time="2026-09-01T10:34:04.108Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C diskcache=1912332a-45bf-4e2a-89f1-fbf8450582b8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:34:13.163" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:34:03.983" pid=902 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2393gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2394gitlab # [ 443.424007] gitaly[902]: time="2026-09-01T10:34:04.108Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=142 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5110 command.oublock=8 command.real_time_ms=118 command.spawn_token_fork_ms=0 command.system_time_ms=96 command.user_time_ms=46 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:34:13.163" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:34:03.983" grpc.time_ms=124.906 pid=902 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2395gitlab # [ 443.448680] gitaly[902]: time="2026-09-01T10:34:04.139Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:34:14.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:34:04.138" grpc.time_ms=0.237 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2396gitlab # [ 443.465534] nixbot[3646]: INFO: ::ffff:127.0.0.1:60790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2397gitlab # [ 443.468694] gitaly[902]: time="2026-09-01T10:34:04.174Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=862 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-01T10:34:14.016" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:04.146" grpc.time_ms=27.652 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2398gitlab # [ 443.602996] gitaly[902]: time="2026-09-01T10:34:04.330Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-01T10:34:34.017" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:04.317" grpc.time_ms=12.719 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2399gitlab # [ 443.662772] gitaly[902]: time="2026-09-01T10:34:04.390Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:34:14.258" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:34:04.389" grpc.time_ms=0.645 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2400gitlab # [ 443.694507] gitaly[902]: time="2026-09-01T10:34:04.407Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-01T10:34:14.264" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-01T10:34:04.394" grpc.time_ms=12.601 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2401gitlab # [ 443.733511] gitaly[902]: time="2026-09-01T10:34:04.461Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:14.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:04.442" grpc.time_ms=19.038 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2402gitlab # [ 443.766545] gitaly[902]: time="2026-09-01T10:34:04.494Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:14.033" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:04.474" grpc.time_ms=19.752 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2403gitlab # [ 443.821859] gitaly[902]: time="2026-09-01T10:34:04.549Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-01T10:34:34.220" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:04.521" grpc.time_ms=28.258 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2404gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2405gitlab # [ 444.463912] gitaly[902]: time="2026-09-01T10:34:05.190Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-01T10:34:15.057" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:05.187" grpc.time_ms=2.545 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2406gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.06 seconds)2407gitlab # [ 444.498293] nixbot[3646]: INFO: ::ffff:127.0.0.1:60800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2408gitlab # [ 444.528892] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:05.254Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 8c7fd6ee9407b1749fcdba0806cebdddee349570 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0e2c5c564d1a941760ae0d08","created_at":"2026-09-01T10:32:30.725Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-352d944d58aa4ed4","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:30.733Z","job_size_bytes":185,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0e2c5c564d1a941760ae0d08: done: 1.488296 sec","job_status":"done","queue_duration_s":93.033196,"scheduling_latency_s":93.033227,"gitaly_calls":13,"gitaly_duration_s":0.368304,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.066933,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.006021,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.010041,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002172,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.007165,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.025638,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015896,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.096,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.351,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.399,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.096,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.957737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007708,"exclusive_lock_hold_duration_s":0.04188806,"duration_s":1.488296,"completed_at":"2026-09-01T10:34:05.254Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.168864,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2409gitlab # [ 444.588300] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:05.258Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","8c7fd6ee9407b1749fcdba0806cebdddee349570 096a5e830794ee3f155bc4093c8cc84aa73a8ef8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"421a9c67f5a508fb5cc445e6","created_at":"2026-09-01T10:32:38.348Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-346bddd8d5974a8a","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:38.379Z","job_size_bytes":185,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-421a9c67f5a508fb5cc445e6: start","job_status":"start","queue_duration_s":86.879267,"scheduling_latency_s":86.879319}2410gitlab # [ 444.604786] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:05.286Z","message":"changes: \"8c7fd6ee9407b1749fcdba0806cebdddee349570 096a5e830794ee3f155bc4093c8cc84aa73a8ef8 refs/heads/master\\n\""}2411gitlab # [ 444.613707] gitaly[902]: time="2026-09-01T10:34:05.341Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:15.191" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:05.322" grpc.time_ms=19.115 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2412gitlab # [ 444.642102] gitaly[902]: time="2026-09-01T10:34:05.369Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:34:15.220" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:34:05.351" grpc.time_ms=18.246 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2413gitlab # [ 444.656707] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:05.380Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2ccdef08729691a0a90384b8","created_at":"2026-09-01T10:34:05.375Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-becadfcb9d6e44c5","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"ee27bf250e8c17b9a7153e46","job_size_bytes":46,"pid":3596,"job_status":"deduplicated","message":"ProjectCacheWorker JID-2ccdef08729691a0a90384b8: deduplicated: until executing","deduplication.type":"until executing"}2414gitlab # [ 444.698627] gitaly[902]: time="2026-09-01T10:34:05.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-01T10:34:15.281" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:05.411" grpc.time_ms=14.365 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2415gitlab # [ 444.729518] gitaly[902]: time="2026-09-01T10:34:05.457Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-01T10:34:35.135" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:05.436" grpc.time_ms=20.615 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2416gitlab # [ 444.770548] gitaly[902]: time="2026-09-01T10:34:05.489Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-01T10:34:15.040" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-01T10:34:05.480" grpc.time_ms=8.437 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2417gitlab # [ 444.798325] gitaly[902]: time="2026-09-01T10:34:05.521Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:15.066" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:05.507" grpc.time_ms=14.294 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2418gitlab # [ 445.129472] gitaly[902]: time="2026-09-01T10:34:05.857Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-01T10:34:15.264" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:05.705" grpc.time_ms=151.526 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2419gitlab # [ 445.180571] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:05.906Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","8c7fd6ee9407b1749fcdba0806cebdddee349570 096a5e830794ee3f155bc4093c8cc84aa73a8ef8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"421a9c67f5a508fb5cc445e6","created_at":"2026-09-01T10:32:38.348Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-346bddd8d5974a8a","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:32:38.379Z","job_size_bytes":185,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-421a9c67f5a508fb5cc445e6: done: 0.648344 sec","job_status":"done","queue_duration_s":86.879267,"scheduling_latency_s":86.879319,"gitaly_calls":7,"gitaly_duration_s":0.279695,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.039523,"redis_read_bytes":500,"redis_write_bytes":11941,"redis_cache_calls":9,"redis_cache_duration_s":0.004176,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001775,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5718,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005564,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.01325,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.014758,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.047,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.047,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.466305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0014548,"exclusive_lock_hold_duration_s":0.03669674,"duration_s":0.648344,"completed_at":"2026-09-01T10:34:05.906Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049006,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2420gitlab # [ 445.248571] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:05.910Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"9ddabe70cc3d9643b41d9b94","created_at":"2026-09-01T10:32:39.931Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-217306c63d9743a0","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:39.942Z","job_size_bytes":65,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-9ddabe70cc3d9643b41d9b94: start","job_status":"start","queue_duration_s":85.968612,"scheduling_latency_s":85.968665}2421gitlab # [ 445.360151] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:06.087Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"9ddabe70cc3d9643b41d9b94","created_at":"2026-09-01T10:32:39.931Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-217306c63d9743a0","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:39.942Z","job_size_bytes":65,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-9ddabe70cc3d9643b41d9b94: done: 0.176387 sec","job_status":"done","queue_duration_s":85.968612,"scheduling_latency_s":85.968665,"redis_calls":16,"redis_duration_s":0.006574,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003371,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002428,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.12027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00074962,"duration_s":0.176387,"completed_at":"2026-09-01T10:34:06.087Z","load_balancing_strategy":"primary","db_duration_s":0.04177,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2422gitlab # [ 445.412400] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:06.090Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"23258c015c8d5726bf7cdac4","created_at":"2026-09-01T10:32:39.943Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-217306c63d9743a0","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:39.955Z","job_size_bytes":65,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-23258c015c8d5726bf7cdac4: start","job_status":"start","queue_duration_s":86.134893,"scheduling_latency_s":86.134932}2423gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2424gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.07 seconds)2425gitlab # [ 445.554472] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:06.280Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"23258c015c8d5726bf7cdac4","created_at":"2026-09-01T10:32:39.943Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-217306c63d9743a0","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:39.955Z","job_size_bytes":65,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-23258c015c8d5726bf7cdac4: done: 0.190484 sec","job_status":"done","queue_duration_s":86.134893,"scheduling_latency_s":86.134932,"redis_calls":21,"redis_duration_s":0.0077529999999999995,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003309,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002198,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002246,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067868,"duration_s":0.190484,"completed_at":"2026-09-01T10:34:06.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2426gitlab # [ 445.658726] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:06.283Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"dc9f5bda958349a275be21c6","created_at":"2026-09-01T10:32:40.149Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-217306c63d9743a0","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:40.162Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dc9f5bda958349a275be21c6: start","job_status":"start","queue_duration_s":86.120763,"scheduling_latency_s":86.120798}2427gitlab # [ 445.678847] nixbot[3646]: INFO: ::ffff:127.0.0.1:60810 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2428gitlab # [ 445.933990] gitaly[902]: time="2026-09-01T10:34:06.660Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:34:06.659" grpc.time_ms=0.899 pid=902 span.kind=server system=grpc2429gitlab # [ 445.988087] gitaly[902]: time="2026-09-01T10:34:06.715Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:34:06.713" grpc.time_ms=1.731 pid=902 span.kind=server system=grpc2430gitlab # [ 446.041775] gitaly[902]: time="2026-09-01T10:34:06.769Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:34:06.768" grpc.time_ms=0.906 pid=902 span.kind=server system=grpc2431gitlab # [ 446.069275] gitaly[902]: time="2026-09-01T10:34:06.784Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX diskcache=1587e177-63b6-44a6-811b-25ba316b1c5e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:34:36.297" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:06.598" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2432gitlab # [ 446.090236] gitaly[902]: time="2026-09-01T10:34:06.785Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=208 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7561 command.oublock=0 command.real_time_ms=178 command.spawn_token_fork_ms=1 command.system_time_ms=124 command.user_time_ms=84 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:34:36.297" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:06.598" grpc.time_ms=186.009 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2433gitlab # [ 446.294367] gitaly[902]: time="2026-09-01T10:34:07.022Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:34:37.019" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:07.020" grpc.time_ms=1.762 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2434gitlab # [ 446.360201] gitaly[902]: time="2026-09-01T10:34:07.087Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8ECP67JBRD8X83PF0J2QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:37.085" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:07.086" grpc.time_ms=1.207 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2435gitlab # [ 446.396538] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:07.118Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"dc9f5bda958349a275be21c6","created_at":"2026-09-01T10:32:40.149Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-217306c63d9743a0","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:32:40.162Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dc9f5bda958349a275be21c6: done: 0.834938 sec","job_status":"done","queue_duration_s":86.120763,"scheduling_latency_s":86.120798,"gitaly_calls":3,"gitaly_duration_s":0.201302,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.046075,"redis_read_bytes":457,"redis_write_bytes":27999,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002121,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002145,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.017815,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006101,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14493,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.009523,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001873,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000943,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003433,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.115,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.045,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.051,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.059,"db_ci_duration_s":0.056,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.489217,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.7043203,"duration_s":0.834938,"completed_at":"2026-09-01T10:34:07.118Z","load_balancing_strategy":"primary","db_duration_s":0.134354,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2436gitlab # [ 446.489305] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:07.120Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ee27bf250e8c17b9a7153e46","created_at":"2026-09-01T10:34:03.873Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-e7698d81f16d42d5","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:03.898Z","job_size_bytes":46,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ee27bf250e8c17b9a7153e46: start","job_status":"start","queue_duration_s":3.221643,"scheduling_latency_s":3.221674}2437gitlab # [ 446.506973] gitaly[902]: time="2026-09-01T10:34:07.201Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-01T16:34:07.189" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:34:07.190" grpc.time_ms=10.811 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2438gitlab # [ 446.517950] gitaly[902]: time="2026-09-01T10:34:07.239Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=594 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-01T10:34:37.220" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:07.220" grpc.time_ms=17.841 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2439gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2440gitlab # [ 446.576001] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:07.302Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ee27bf250e8c17b9a7153e46","created_at":"2026-09-01T10:34:03.873Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-e7698d81f16d42d5","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:03.898Z","job_size_bytes":46,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ee27bf250e8c17b9a7153e46: done: 0.181649 sec","job_status":"done","queue_duration_s":3.221643,"scheduling_latency_s":3.221674,"gitaly_calls":2,"gitaly_duration_s":0.036658,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.012151,"redis_read_bytes":69,"redis_write_bytes":4885,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002306,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001214,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2113,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00254,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.005085,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.114153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058882,"duration_s":0.181649,"completed_at":"2026-09-01T10:34:07.302Z","load_balancing_strategy":"primary","db_duration_s":0.020754,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2441gitlab # [ 446.654481] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:07.305Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"08c741dbd47056639bb5eca0","created_at":"2026-09-01T10:34:03.926Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-e7698d81f16d42d5","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:03.934Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-08c741dbd47056639bb5eca0: start","job_status":"start","queue_duration_s":3.370429,"scheduling_latency_s":3.370468}2442gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.10 seconds)2443gitlab # [ 446.678174] gitaly[902]: time="2026-09-01T10:34:07.386Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C diskcache=8ee91791-9573-49d5-9fde-a77446e6466b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:34:07.344" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:07.344" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2444gitlab # [ 446.691664] nixbot[3646]: INFO: ::ffff:127.0.0.1:60812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2445gitlab # [ 446.694111] gitaly[902]: time="2026-09-01T10:34:07.386Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=46 command.spawn_token_fork_ms=13 command.system_time_ms=21 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:34:07.344" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:07.344" grpc.time_ms=41.478 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2446gitlab # [ 446.747784] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:07.474Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"08c741dbd47056639bb5eca0","created_at":"2026-09-01T10:34:03.926Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-e7698d81f16d42d5","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:03.934Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-08c741dbd47056639bb5eca0: done: 0.169448 sec","job_status":"done","queue_duration_s":3.370429,"scheduling_latency_s":3.370468,"gitaly_calls":1,"gitaly_duration_s":0.045311,"redis_calls":15,"redis_duration_s":0.005856999999999999,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002485,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000876,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001936,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.024,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.047,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12353074,"duration_s":0.169448,"completed_at":"2026-09-01T10:34:07.474Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2447gitlab # [ 446.811810] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:07.478Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"b81acd0a52ef76c52472a771","created_at":"2026-09-01T10:34:04.128Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-e7698d81f16d42d5","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:04.133Z","job_size_bytes":23,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b81acd0a52ef76c52472a771: start","job_status":"start","queue_duration_s":3.344948,"scheduling_latency_s":3.344996}2448gitlab # [ 446.828042] gitaly[902]: time="2026-09-01T10:34:07.553Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-01T10:34:37.233" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:07.533" grpc.time_ms=19.105 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2449gitlab # [ 446.847817] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:07.574Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"b81acd0a52ef76c52472a771","created_at":"2026-09-01T10:34:04.128Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-e7698d81f16d42d5","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:04.133Z","job_size_bytes":23,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b81acd0a52ef76c52472a771: done: 0.096306 sec","job_status":"done","queue_duration_s":3.344948,"scheduling_latency_s":3.344996,"gitaly_calls":1,"gitaly_duration_s":0.023308,"redis_calls":16,"redis_duration_s":0.00715,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000532,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002867,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001358,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.096306,"completed_at":"2026-09-01T10:34:07.574Z","load_balancing_strategy":"primary","db_duration_s":0.005668,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2450gitlab # [ 446.897645] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:07.578Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"77d8e5010b08e7ae755bbe8a","created_at":"2026-09-01T10:34:04.980Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-e7698d81f16d42d5","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e66804ca9d721b88d4232174775cd0e2c797bf54e95f99efbddcc0a1e0dac738","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:04.987Z","job_size_bytes":467,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-77d8e5010b08e7ae755bbe8a: start","job_status":"start","queue_duration_s":2.590779,"scheduling_latency_s":2.590824}2451gitlab # [ 446.914681] gitaly[902]: time="2026-09-01T10:34:07.630Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:37.328" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:07.628" grpc.time_ms=1.193 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2452gitlab # [ 446.927094] gitaly[902]: time="2026-09-01T10:34:07.653Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:34:17.195" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:07.635" grpc.time_ms=17.76 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2453gitlab # [ 447.126226] gitaly[902]: time="2026-09-01T10:34:07.852Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:34:37.550" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:07.851" grpc.time_ms=1.517 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2454gitlab # [ 447.166138] gitaly[902]: time="2026-09-01T10:34:07.863Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=28 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-01T10:34:37.558" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:07.858" grpc.time_ms=4.647 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2455gitlab # [ 447.264955] gitaly[902]: time="2026-09-01T10:34:07.992Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:17.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:07.973" grpc.time_ms=18.894 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2456gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2457gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.07 seconds)2458gitlab # [ 447.742045] nixbot[3646]: INFO: ::ffff:127.0.0.1:60824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2459gitlab # [ 447.969545] gitaly[902]: time="2026-09-01T10:34:08.697Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=3 command.system_time_ms=19 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-01T10:34:38.365" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:08.666" grpc.time_ms=30.766 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2460gitlab # [ 448.011975] gitaly[902]: time="2026-09-01T10:34:08.726Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8E3B9EXKM2M5B0T5XRE2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-01T10:34:38.403" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:08.704" grpc.time_ms=22.199 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2461gitlab # [ 448.070629] sidekiq-cluster[3596]: {"severity":"WARN","time":"2026-09-01T10:34:08.797Z","class":"CreatePipelineWorker","correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"8c7fd6ee9407b1749fcdba0806cebdddee349570","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"8c7fd6ee9407b1749fcdba0806cebdddee349570","ref":"refs/heads/master"},"retry":0}2462gitlab # [ 448.092078] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:08.815Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"77d8e5010b08e7ae755bbe8a","created_at":"2026-09-01T10:34:04.980Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-e7698d81f16d42d5","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e66804ca9d721b88d4232174775cd0e2c797bf54e95f99efbddcc0a1e0dac738","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:04.987Z","job_size_bytes":467,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-77d8e5010b08e7ae755bbe8a: done: 1.237756 sec","job_status":"done","queue_duration_s":2.590779,"scheduling_latency_s":2.590824,"gitaly_calls":7,"gitaly_duration_s":0.12623,"redis_calls":51,"redis_duration_s":0.018229,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001889,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.007567,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002493,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004347,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.017966,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00079214,"duration_s":1.237756,"completed_at":"2026-09-01T10:34:08.815Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.098641,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2463gitlab # [ 448.169468] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:08.820Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a4391cf3-ce08-4fea-86c3-9ccfbd4fd282\"}"],"class":"WebHookWorker","jid":"bbae0c1824de09651c87928e","created_at":"2026-09-01T10:34:05.142Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-e7698d81f16d42d5","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c323ef0c29f64d99f50d0e3e41860fb6d422f8d19dd195d126014f0ff77856f8","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:05.150Z","job_size_bytes":1751,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-bbae0c1824de09651c87928e: start","job_status":"start","queue_duration_s":3.670483,"scheduling_latency_s":3.670539}2464gitlab # [ 448.360234] nixbot[3646]: INFO: ::ffff:127.0.0.1:60840 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2465gitlab # [ 448.404780] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:09.131Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a4391cf3-ce08-4fea-86c3-9ccfbd4fd282\"}"],"class":"WebHookWorker","jid":"bbae0c1824de09651c87928e","created_at":"2026-09-01T10:34:05.142Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-e7698d81f16d42d5","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c323ef0c29f64d99f50d0e3e41860fb6d422f8d19dd195d126014f0ff77856f8","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:05.150Z","job_size_bytes":1751,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-bbae0c1824de09651c87928e: done: 0.310831 sec","job_status":"done","queue_duration_s":3.670483,"scheduling_latency_s":3.670539,"redis_calls":19,"redis_duration_s":0.007161,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001886,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000731,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003014,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00153,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09248195999998643,"cpu_s":0.189957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006507,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.310831,"completed_at":"2026-09-01T10:34:09.131Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2466gitlab # [ 448.515965] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:09.134Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"19f8338e579191e003774cd2","created_at":"2026-09-01T10:34:05.395Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-becadfcb9d6e44c5","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"08c741dbd47056639bb5eca0","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:05.402Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-19f8338e579191e003774cd2: start","job_status":"start","queue_duration_s":3.732676,"scheduling_latency_s":3.732722}2467gitlab # [ 448.538987] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:09.226Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"19f8338e579191e003774cd2","created_at":"2026-09-01T10:34:05.395Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-becadfcb9d6e44c5","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"08c741dbd47056639bb5eca0","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:05.402Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-19f8338e579191e003774cd2: done: 0.091731 sec","job_status":"done","queue_duration_s":3.732676,"scheduling_latency_s":3.732722,"gitaly_calls":1,"gitaly_duration_s":0.019545,"redis_calls":12,"redis_duration_s":0.007389,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003557,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0529043,"duration_s":0.091731,"completed_at":"2026-09-01T10:34:09.226Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2468gitlab # [ 448.586675] gitaly[902]: time="2026-09-01T10:34:09.191Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N diskcache=fda69f1a-3b30-456f-aa6b-264fa204c478 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:34:09.176" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:09.177" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2469gitlab # [ 448.596506] gitaly[902]: time="2026-09-01T10:34:09.192Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:34:09.176" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:09.177" grpc.time_ms=14.503 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2470gitlab # [ 448.609638] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1632471gitlab # [ 448.611755] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:09.229Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4748d80e16f7d36fdd6a8436","created_at":"2026-09-01T10:34:05.631Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-becadfcb9d6e44c5","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9d7ee6df3b5e95b3065a137ab333959df63672ad58872bca2a0878964f9a539b","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:05.638Z","job_size_bytes":467,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4748d80e16f7d36fdd6a8436: start","job_status":"start","queue_duration_s":3.590638,"scheduling_latency_s":3.59067}2472gitlab # [ 448.628720] gitaly[902]: time="2026-09-01T10:34:09.266Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:39.265" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:09.265" grpc.time_ms=0.731 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2473gitlab # [ 448.640513] gitaly[902]: time="2026-09-01T10:34:09.289Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=5 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:34:19.000" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:09.271" grpc.time_ms=18.203 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2474gitlab # [ 448.653144] gitaly[902]: time="2026-09-01T10:34:09.302Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H4BKAC2FJXBDTB6PYG99 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:09.287" grpc.time_ms=14.996 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2475gitlab # [ 448.665925] gitaly[902]: time="2026-09-01T10:34:09.344Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:34:39.343" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:09.343" grpc.time_ms=0.993 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2476gitlab # [ 448.679302] gitaly[902]: time="2026-09-01T10:34:09.353Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=188 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-01T10:34:39.347" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:09.348" grpc.time_ms=5.018 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2477gitlab # [ 448.695077] gitaly[902]: time="2026-09-01T10:34:09.401Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:19.120" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:09.390" grpc.time_ms=11.143 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2478gitlab # [ 448.707922] gitaly[902]: time="2026-09-01T10:34:09.435Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H4GS0PQJ0VBYWCMFQ7F3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:09.419" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2479gitlab # [ 448.718030] gitaly[902]: time="2026-09-01T10:34:09.435Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H4GS0PQJ0VBYWCMFQ7F3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:09.419" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2480gitlab # [ 448.731218] gitlab-workhorse[817]: time="2026-09-01T10:34:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672481gitlab # [ 448.733080] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1312482gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2483gitlab # [ 448.734917] gitaly[902]: time="2026-09-01T10:34:09.436Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H4GS0PQJ0VBYWCMFQ7F3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:09.419" grpc.time_ms=16.751 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2484gitlab # [ 448.750213] nixbot[3646]: {"ts": "2026-09-01T10:34:09.477Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2485gitlab # [ 448.789390] nixbot[3646]: INFO: ::ffff:127.0.0.1:60846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2486gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2487gitlab # [ 448.871318] gitaly[902]: time="2026-09-01T10:34:09.598Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H4PQW2AQQDR7HK22QQZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:39.397" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:09.597" grpc.time_ms=0.875 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2488gitlab # [ 448.981480] gitaly[902]: time="2026-09-01T10:34:09.709Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H4PQW2AQQDR7HK22QQZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:19.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:09.691" grpc.time_ms=18.027 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2489gitlab # [ 449.113211] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3442490gitlab # [ 449.121423] nixbot[3646]: {"ts": "2026-09-01T10:34:09.842Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 \"HTTP/1.1 201 Created\""}2491gitlab # [ 449.207091] gitaly[902]: time="2026-09-01T10:34:09.934Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H51RQ92DNNF00XZXEMH3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:39.732" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:09.933" grpc.time_ms=1.252 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2492gitlab # [ 449.281460] gitaly[902]: time="2026-09-01T10:34:10.009Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H51RQ92DNNF00XZXEMH3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:19.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:09.990" grpc.time_ms=18.553 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2493gitlab # [ 449.391422] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2702494gitlab # [ 449.399659] nixbot[3646]: {"ts": "2026-09-01T10:34:10.121Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 \"HTTP/1.1 201 Created\""}2495gitlab # [ 449.415033] gitaly[902]: time="2026-09-01T10:34:10.142Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-01T10:34:40.121" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:10.122" grpc.time_ms=20.392 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2496gitlab # [ 449.457418] gitaly[902]: time="2026-09-01T10:34:10.176Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=8 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8EB36T06ZX5EWVGDC5G1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-01T10:34:40.149" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:10.149" grpc.time_ms=26.783 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2497gitlab # [ 449.481147] gitaly[902]: time="2026-09-01T10:34:10.206Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H5AHXXRWSBJWPV5FC7Y1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:40.205" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:10.206" grpc.time_ms=0.699 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2498gitlab # [ 449.499273] sidekiq-cluster[3596]: {"severity":"WARN","time":"2026-09-01T10:34:10.206Z","class":"CreatePipelineWorker","correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"8c7fd6ee9407b1749fcdba0806cebdddee349570","after":"096a5e830794ee3f155bc4093c8cc84aa73a8ef8","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"096a5e830794ee3f155bc4093c8cc84aa73a8ef8","ref":"refs/heads/master"},"retry":0}2499gitlab # [ 449.509424] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.219Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4748d80e16f7d36fdd6a8436","created_at":"2026-09-01T10:34:05.631Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-becadfcb9d6e44c5","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9d7ee6df3b5e95b3065a137ab333959df63672ad58872bca2a0878964f9a539b","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:05.638Z","job_size_bytes":467,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4748d80e16f7d36fdd6a8436: done: 0.990166 sec","job_status":"done","queue_duration_s":3.590638,"scheduling_latency_s":3.59067,"gitaly_calls":7,"gitaly_duration_s":0.108997,"redis_calls":33,"redis_duration_s":0.011702,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.002617,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002222,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.005269,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001594,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.8513,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.990166,"completed_at":"2026-09-01T10:34:10.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030286,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2500gitlab # [ 449.567009] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.223Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"cc4ce75e-4547-4050-9a50-ca93a8f80203\"}"],"class":"WebHookWorker","jid":"289744eb4fee21d2005ee172","created_at":"2026-09-01T10:34:05.673Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-becadfcb9d6e44c5","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c456966f701813df126d0996f69295717989c8856891d9a26f912f6bd4522e4f","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:05.679Z","job_size_bytes":1749,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-289744eb4fee21d2005ee172: start","job_status":"start","queue_duration_s":4.544088,"scheduling_latency_s":4.544135}2501gitlab # [ 449.585538] gitaly[902]: time="2026-09-01T10:34:10.275Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H5AHXXRWSBJWPV5FC7Y1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:20.177" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:10.257" grpc.time_ms=17.228 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2502gitlab # [ 449.599794] nixbot[3646]: INFO: ::ffff:127.0.0.1:60852 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2503gitlab # [ 449.619349] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.345Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"cc4ce75e-4547-4050-9a50-ca93a8f80203\"}"],"class":"WebHookWorker","jid":"289744eb4fee21d2005ee172","created_at":"2026-09-01T10:34:05.673Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-becadfcb9d6e44c5","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c456966f701813df126d0996f69295717989c8856891d9a26f912f6bd4522e4f","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:05.679Z","job_size_bytes":1749,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-289744eb4fee21d2005ee172: done: 0.122681 sec","job_status":"done","queue_duration_s":4.544088,"scheduling_latency_s":4.544135,"redis_calls":14,"redis_duration_s":0.006784999999999999,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000555,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004258,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001972,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.012101840000013908,"cpu_s":0.078977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.122681,"completed_at":"2026-09-01T10:34:10.345Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2504gitlab # [ 449.693328] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2292505gitlab # [ 449.696240] nixbot[3646]: {"ts": "2026-09-01T10:34:10.361Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8c7fd6ee9407b1749fcdba0806cebdddee349570 \"HTTP/1.1 201 Created\""}2506gitlab # [ 449.699190] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.352Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1f25b5b787cbe4ed9e8e7776","created_at":"2026-09-01T10:34:06.563Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.575Z","job_size_bytes":23,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1f25b5b787cbe4ed9e8e7776: start","job_status":"start","queue_duration_s":3.776759,"scheduling_latency_s":3.776787}2507gitlab # [ 449.748994] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1252508gitlab # [ 449.753353] gitaly[902]: time="2026-09-01T10:34:10.477Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H5HF4M1MQNGX7W6NQEWF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.463" grpc.time_ms=11.805 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2509gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2510gitlab # [ 449.773735] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.488Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1f25b5b787cbe4ed9e8e7776","created_at":"2026-09-01T10:34:06.563Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.575Z","job_size_bytes":23,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1f25b5b787cbe4ed9e8e7776: done: 0.136379 sec","job_status":"done","queue_duration_s":3.776759,"scheduling_latency_s":3.776787,"redis_calls":10,"redis_duration_s":0.005927,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000868,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046896,"duration_s":0.136379,"completed_at":"2026-09-01T10:34:10.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024937,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2511gitlab # [ 449.822424] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.490Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5bd8c4f6046f6eb5eeb4bccc","created_at":"2026-09-01T10:34:06.796Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.809Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5bd8c4f6046f6eb5eeb4bccc: start","job_status":"start","queue_duration_s":3.6804,"scheduling_latency_s":3.680426}2512gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.05 seconds)2513gitlab # [ 449.839812] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.559Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5bd8c4f6046f6eb5eeb4bccc","created_at":"2026-09-01T10:34:06.796Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.809Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5bd8c4f6046f6eb5eeb4bccc: done: 0.06943 sec","job_status":"done","queue_duration_s":3.6804,"scheduling_latency_s":3.680426,"redis_calls":10,"redis_duration_s":0.006027,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002231,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0015515,"duration_s":0.06943,"completed_at":"2026-09-01T10:34:10.559Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2514gitlab # [ 449.883314] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.562Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9703dfd48599a914950a673a","created_at":"2026-09-01T10:34:06.834Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.852Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9703dfd48599a914950a673a: start","job_status":"start","queue_duration_s":3.710605,"scheduling_latency_s":3.710636}2515gitlab # [ 449.899207] nixbot[3646]: INFO: ::ffff:127.0.0.1:60856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2516gitlab # [ 449.901223] gitlab-workhorse[817]: time="2026-09-01T10:34:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672517gitlab # [ 449.902997] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1022518gitlab # [ 449.904900] gitaly[902]: time="2026-09-01T10:34:10.580Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H5NENXRV6GPC8JRBK6EA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.569" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2519gitlab # [ 449.914749] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9703dfd48599a914950a673a","created_at":"2026-09-01T10:34:06.834Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.852Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9703dfd48599a914950a673a: done: 0.053442 sec","job_status":"done","queue_duration_s":3.710605,"scheduling_latency_s":3.710636,"redis_calls":10,"redis_duration_s":0.0059770000000000005,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005002,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00049,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041294,"duration_s":0.053442,"completed_at":"2026-09-01T10:34:10.616Z","load_balancing_strategy":"primary","db_duration_s":0.007572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2520gitlab # [ 449.958652] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.618Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"6228b14e1bf9c72a68e2221f","created_at":"2026-09-01T10:34:06.884Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.896Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6228b14e1bf9c72a68e2221f: start","job_status":"start","queue_duration_s":3.72133,"scheduling_latency_s":3.72135}2521gitlab # [ 449.974027] gitaly[902]: time="2026-09-01T10:34:10.580Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H5NENXRV6GPC8JRBK6EA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.569" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2522gitlab # [ 449.987046] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.674Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"6228b14e1bf9c72a68e2221f","created_at":"2026-09-01T10:34:06.884Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.896Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6228b14e1bf9c72a68e2221f: done: 0.056042 sec","job_status":"done","queue_duration_s":3.72133,"scheduling_latency_s":3.72135,"redis_calls":13,"redis_duration_s":0.0036880000000000003,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001525,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000408,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032406,"duration_s":0.056042,"completed_at":"2026-09-01T10:34:10.674Z","load_balancing_strategy":"primary","db_duration_s":0.01196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2523gitlab # [ 450.030966] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.675Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0928843b2228492784bc0cad","created_at":"2026-09-01T10:34:06.898Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.908Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0928843b2228492784bc0cad: start","job_status":"start","queue_duration_s":3.767274,"scheduling_latency_s":3.767298}2524gitlab # [ 450.047141] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 772525gitlab # [ 450.049240] gitaly[902]: time="2026-09-01T10:34:10.580Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H5NENXRV6GPC8JRBK6EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.569" grpc.time_ms=11.1 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2526gitlab # [ 450.062936] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.727Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0928843b2228492784bc0cad","created_at":"2026-09-01T10:34:06.898Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.908Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0928843b2228492784bc0cad: done: 0.05121 sec","job_status":"done","queue_duration_s":3.767274,"scheduling_latency_s":3.767298,"redis_calls":10,"redis_duration_s":0.002872,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000381,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002052,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038332,"duration_s":0.05121,"completed_at":"2026-09-01T10:34:10.726Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2527gitlab # [ 450.107805] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"fd40ecb48ae9ba95ec60dc21","created_at":"2026-09-01T10:34:06.909Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.922Z","job_size_bytes":19,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-fd40ecb48ae9ba95ec60dc21: start","job_status":"start","queue_duration_s":3.807445,"scheduling_latency_s":3.807473}2528gitlab # [ 450.124183] gitlab-workhorse[817]: time="2026-09-01T10:34:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672529gitlab # [ 450.127133] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 702530gitlab # [ 450.129110] gitaly[902]: time="2026-09-01T10:34:10.705Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H5T4CX8C3P4S1HSXRDNP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.696" grpc.time_ms=9.08 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2531gitlab # [ 450.141989] gitaly[902]: time="2026-09-01T10:34:10.776Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H5WKCA7M31FH10WP37SH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.765" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2532gitlab # [ 450.152095] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.769Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"fd40ecb48ae9ba95ec60dc21","created_at":"2026-09-01T10:34:06.909Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.922Z","job_size_bytes":19,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-fd40ecb48ae9ba95ec60dc21: done: 0.039709 sec","job_status":"done","queue_duration_s":3.807445,"scheduling_latency_s":3.807473,"redis_calls":11,"redis_duration_s":0.005117,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004046,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000589,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0018508,"duration_s":0.039709,"completed_at":"2026-09-01T10:34:10.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2533gitlab # [ 450.195759] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.770Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5560ca883f55bfcead8e20a0","created_at":"2026-09-01T10:34:06.927Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.937Z","job_size_bytes":66,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5560ca883f55bfcead8e20a0: start","job_status":"start","queue_duration_s":3.833616,"scheduling_latency_s":3.833634}2534gitlab # [ 450.212703] gitaly[902]: time="2026-09-01T10:34:10.777Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H5WKCA7M31FH10WP37SH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.765" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2535gitlab # [ 450.225629] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.818Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5560ca883f55bfcead8e20a0","created_at":"2026-09-01T10:34:06.927Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.937Z","job_size_bytes":66,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5560ca883f55bfcead8e20a0: done: 0.047785 sec","job_status":"done","queue_duration_s":3.833616,"scheduling_latency_s":3.833634,"redis_calls":10,"redis_duration_s":0.004597,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002549,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003709,"duration_s":0.047785,"completed_at":"2026-09-01T10:34:10.818Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00843,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2536gitlab # [ 450.269399] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.819Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f0a8cab72e069d8e3305bba2","created_at":"2026-09-01T10:34:06.940Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.948Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f0a8cab72e069d8e3305bba2: start","job_status":"start","queue_duration_s":3.871136,"scheduling_latency_s":3.871154}2537gitlab # [ 450.285982] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 692538gitlab # [ 450.287944] gitlab-workhorse[817]: time="2026-09-01T10:34:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162539gitlab # [ 450.289839] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 992540gitlab # [ 450.291624] gitaly[902]: time="2026-09-01T10:34:10.778Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H5WKCA7M31FH10WP37SH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.765" grpc.time_ms=11.359 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2541gitlab # [ 450.305963] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.876Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f0a8cab72e069d8e3305bba2","created_at":"2026-09-01T10:34:06.940Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.948Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f0a8cab72e069d8e3305bba2: done: 0.056248 sec","job_status":"done","queue_duration_s":3.871136,"scheduling_latency_s":3.871154,"redis_calls":10,"redis_duration_s":0.004815,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001138,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00315,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026632,"duration_s":0.056248,"completed_at":"2026-09-01T10:34:10.876Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2542gitlab # [ 450.349951] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.877Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a8e1247d8152cf0458942367","created_at":"2026-09-01T10:34:06.960Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.967Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a8e1247d8152cf0458942367: start","job_status":"start","queue_duration_s":3.909965,"scheduling_latency_s":3.909985}2543gitlab # [ 450.365781] gitaly[902]: time="2026-09-01T10:34:10.890Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H605BSNPEXBWKD4FZE1B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.874" grpc.time_ms=16.511 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2544gitlab # [ 450.378870] gitaly[902]: time="2026-09-01T10:34:10.992Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H62DBJRWDRBPDNZ7KA3E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.971" pid=902 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2545gitlab # [ 450.388768] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.926Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a8e1247d8152cf0458942367","created_at":"2026-09-01T10:34:06.960Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.967Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a8e1247d8152cf0458942367: done: 0.048527 sec","job_status":"done","queue_duration_s":3.909965,"scheduling_latency_s":3.909985,"redis_calls":10,"redis_duration_s":0.00184,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000355,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027626,"duration_s":0.048527,"completed_at":"2026-09-01T10:34:10.926Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012041,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2546gitlab # [ 450.431464] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.927Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6eeb69e06601d982844a560c","created_at":"2026-09-01T10:34:06.968Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.975Z","job_size_bytes":6,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6eeb69e06601d982844a560c: start","job_status":"start","queue_duration_s":3.951909,"scheduling_latency_s":3.951928}2547gitlab # [ 450.447015] gitaly[902]: time="2026-09-01T10:34:10.992Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H62DBJRWDRBPDNZ7KA3E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.971" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2548gitlab # [ 450.460518] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.956Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6eeb69e06601d982844a560c","created_at":"2026-09-01T10:34:06.968Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.975Z","job_size_bytes":6,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6eeb69e06601d982844a560c: done: 0.028565 sec","job_status":"done","queue_duration_s":3.951909,"scheduling_latency_s":3.951928,"redis_calls":10,"redis_duration_s":0.001685,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000355,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000365,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026762,"duration_s":0.028565,"completed_at":"2026-09-01T10:34:10.956Z","load_balancing_strategy":"primary","db_duration_s":0.00338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2549gitlab # [ 450.503683] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:10.958Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6ad1407f4bd8f041906c08e8","created_at":"2026-09-01T10:34:06.976Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.983Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6ad1407f4bd8f041906c08e8: start","job_status":"start","queue_duration_s":3.974748,"scheduling_latency_s":3.974767}2550gitlab # [ 450.518725] gitaly[902]: time="2026-09-01T10:34:10.993Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H62DBJRWDRBPDNZ7KA3E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:34:10.971" grpc.time_ms=21.442 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2551gitlab # [ 450.534483] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.014Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6ad1407f4bd8f041906c08e8","created_at":"2026-09-01T10:34:06.976Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:06.983Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6ad1407f4bd8f041906c08e8: done: 0.056302 sec","job_status":"done","queue_duration_s":3.974748,"scheduling_latency_s":3.974767,"redis_calls":10,"redis_duration_s":0.0020169999999999997,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000359,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042096,"duration_s":0.056302,"completed_at":"2026-09-01T10:34:11.014Z","load_balancing_strategy":"primary","db_duration_s":0.012148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2552gitlab # [ 450.576801] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.016Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"2e040b8592378ea45503bf4a","created_at":"2026-09-01T10:34:06.993Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:07.001Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-2e040b8592378ea45503bf4a: start","job_status":"start","queue_duration_s":4.014683,"scheduling_latency_s":4.01471}2553gitlab # [ 450.592451] gitaly[902]: time="2026-09-01T10:34:11.098Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:41.095" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:11.096" grpc.time_ms=1.542 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2554gitlab # [ 450.604781] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.116Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"2e040b8592378ea45503bf4a","created_at":"2026-09-01T10:34:06.993Z","trace_propagation_headers":{"sentry-trace":"98ae57cf9ab9470da2ea15c23a82e39a-4311a4ebd07c42d2","baggage":"sentry-trace_id=98ae57cf9ab9470da2ea15c23a82e39a,sentry-release=Unknown"},"correlation_id":"01M1E8ECP67JBRD8X83PF0J2QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:07.001Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-2e040b8592378ea45503bf4a: done: 0.100291 sec","job_status":"done","queue_duration_s":4.014683,"scheduling_latency_s":4.01471,"redis_calls":14,"redis_duration_s":0.002466,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000406,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027902,"duration_s":0.100291,"completed_at":"2026-09-01T10:34:11.116Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2555gitlab # [ 450.647548] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.120Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"271080618d3f33cafb7210ba","created_at":"2026-09-01T10:34:07.261Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-ba779fa456304c43","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:07.274Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-271080618d3f33cafb7210ba: start","job_status":"start","queue_duration_s":3.846838,"scheduling_latency_s":3.846895}2556gitlab # [ 450.663388] gitaly[902]: time="2026-09-01T10:34:11.124Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=589 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-01T10:34:41.113" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:11.113" grpc.time_ms=10.784 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2557gitlab # [ 450.677104] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.223Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"271080618d3f33cafb7210ba","created_at":"2026-09-01T10:34:07.261Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-ba779fa456304c43","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:07.274Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-271080618d3f33cafb7210ba: done: 0.102288 sec","job_status":"done","queue_duration_s":3.846838,"scheduling_latency_s":3.846895,"redis_calls":19,"redis_duration_s":0.005947,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001284,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000756,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002812,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.015879439999999998,"duration_s":0.102288,"completed_at":"2026-09-01T10:34:11.222Z","load_balancing_strategy":"primary","db_duration_s":0.009754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2558gitlab # [ 450.720951] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.225Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","bbae0c1824de09651c87928e"],"class":"WebHooks::LogExecutionWorker","jid":"7b54be11d630a62f3b018c57","created_at":"2026-09-01T10:34:09.094Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-44a05626c5664db8","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6f32858d377e2a975d01e27458cba365adbe9eda83ee513529e9dd981fe48f18","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:09.110Z","job_size_bytes":2593,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7b54be11d630a62f3b018c57: start","job_status":"start","queue_duration_s":2.114976,"scheduling_latency_s":2.115008}2559gitlab # [ 450.738798] gitaly[902]: time="2026-09-01T10:34:11.145Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:21.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:11.135" grpc.time_ms=9.263 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2560gitlab # [ 450.752495] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.291Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","bbae0c1824de09651c87928e"],"class":"WebHooks::LogExecutionWorker","jid":"7b54be11d630a62f3b018c57","created_at":"2026-09-01T10:34:09.094Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-44a05626c5664db8","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6f32858d377e2a975d01e27458cba365adbe9eda83ee513529e9dd981fe48f18","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:09.110Z","job_size_bytes":2593,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7b54be11d630a62f3b018c57: done: 0.066608 sec","job_status":"done","queue_duration_s":2.114976,"scheduling_latency_s":2.115008,"redis_calls":10,"redis_duration_s":0.003817,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00184,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001506,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003817,"duration_s":0.066608,"completed_at":"2026-09-01T10:34:11.291Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011683,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2561gitlab # [ 450.797314] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.293Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c6abd5d676a8c60b31df5d03","created_at":"2026-09-01T10:34:09.789Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-cc55efc773b547b4","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:09.802Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c6abd5d676a8c60b31df5d03: start","job_status":"start","queue_duration_s":1.490467,"scheduling_latency_s":1.490498}2562gitlab # [ 450.813372] gitaly[902]: time="2026-09-01T10:34:11.174Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:34:21.043" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:34:11.173" grpc.time_ms=0.319 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2563gitlab # [ 450.824326] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4382564gitlab # [ 450.826710] nixbot[3646]: {"ts": "2026-09-01T10:34:11.468Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/096a5e830794ee3f155bc4093c8cc84aa73a8ef8 \"HTTP/1.1 201 Created\""}2565gitlab # [ 450.829481] nixbot[3646]: {"ts": "2026-09-01T10:34:11.477Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-096a5e830794-4"}2566gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8'2567gitlab # [ 450.831731] gitaly[902]: time="2026-09-01T10:34:11.191Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:34:21.049" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:11.180" grpc.time_ms=10.781 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2568gitlab # [ 450.844994] gitaly[902]: time="2026-09-01T10:34:11.233Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:34:11.233" grpc.time_ms=0.508 pid=902 span.kind=server system=grpc2569gitlab # [ 450.853652] gitaly[902]: time="2026-09-01T10:34:11.272Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:34:11.271" grpc.time_ms=0.989 pid=902 span.kind=server system=grpc2570gitlab # [ 450.862332] gitaly[902]: time="2026-09-01T10:34:11.284Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK diskcache=a3759ec1-a7bb-4f0d-a6b3-8a59a142d90a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:34:21.064" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:34:11.194" pid=902 ref=refs/keep-around/096a5e830794ee3f155bc4093c8cc84aa73a8ef8 remote_ip="2001:db8:1::1" revision=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 span.kind=server system=grpc username=root2571gitlab # [ 450.872748] gitaly[902]: time="2026-09-01T10:34:11.284Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=76 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4991 command.oublock=8 command.real_time_ms=83 command.spawn_token_fork_ms=0 command.system_time_ms=47 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:34:21.064" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:34:11.194" grpc.time_ms=90.149 pid=902 ref=refs/keep-around/096a5e830794ee3f155bc4093c8cc84aa73a8ef8 remote_ip="2001:db8:1::1" revision=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 span.kind=server system=grpc username=root2572gitlab # [ 450.886215] gitaly[902]: time="2026-09-01T10:34:11.291Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:41.289" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:11.290" grpc.time_ms=0.649 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2573gitlab # [ 450.898689] gitaly[902]: time="2026-09-01T10:34:11.424Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8H4PQW2AQQDR7HK22QQZD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:34:11.422" grpc.time_ms=0.592 pid=902 span.kind=server system=grpc2574gitlab # [ 450.908224] gitaly[902]: time="2026-09-01T10:34:11.451Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8H4PQW2AQQDR7HK22QQZD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:34:11.450" grpc.time_ms=0.677 pid=902 span.kind=server system=grpc2575gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8', in 0.08 seconds)2576(finished: subtest: push delivers the webhook, in 94.57 seconds)2577subtest: eval and build post commit statuses2578gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses2579gitlab # [ 450.917500] gitaly[902]: time="2026-09-01T10:34:11.488Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8H4PQW2AQQDR7HK22QQZD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:34:11.487" grpc.time_ms=0.597 pid=902 span.kind=server system=grpc2580gitlab # [ 450.927628] gitaly[902]: time="2026-09-01T10:34:11.496Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H4PQW2AQQDR7HK22QQZD diskcache=dafbbdc2-5915-46d0-9167-beafad2aa0f3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:34:41.385" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:11.385" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2581gitlab # [ 450.937449] gitaly[902]: time="2026-09-01T10:34:11.497Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=99 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7043 command.oublock=0 command.real_time_ms=105 command.spawn_token_fork_ms=1 command.system_time_ms=64 command.user_time_ms=35 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H4PQW2AQQDR7HK22QQZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:34:41.385" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:11.385" grpc.time_ms=111.481 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2582gitlab # [ 450.951825] nixbot[3646]: INFO: ::ffff:127.0.0.1:60380 - "GET /api/repos/gitlab/root/test-flake/builds?commit=096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 200 OK2583gitlab # [ 450.953859] nixbot[3646]: {"ts": "2026-09-01T10:34:11.669Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-096a5e830794-4", "argv0": "bwrap"}2584gitlab # [ 450.956162] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.645Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c6abd5d676a8c60b31df5d03","created_at":"2026-09-01T10:34:09.789Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-cc55efc773b547b4","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:09.802Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3596,"job_status":"rescheduled","message":"PipelineProcessWorker JID-c6abd5d676a8c60b31df5d03: rescheduled"}2585gitlab # [ 450.971193] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.659Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c6abd5d676a8c60b31df5d03","created_at":"2026-09-01T10:34:09.789Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-cc55efc773b547b4","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:09.802Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c6abd5d676a8c60b31df5d03: done: 0.366092 sec","job_status":"done","queue_duration_s":1.490467,"scheduling_latency_s":1.490498,"gitaly_calls":3,"gitaly_duration_s":0.123182,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015832,"redis_read_bytes":151,"redis_write_bytes":18010,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000655,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00161,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.004234,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12309,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005427,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000365,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000496,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00239,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192929,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.30595706,"duration_s":0.366092,"completed_at":"2026-09-01T10:34:11.659Z","load_balancing_strategy":"primary","db_duration_s":0.046333,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2586gitlab # [ 451.022022] gitaly[902]: time="2026-09-01T10:34:11.577Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H4PQW2AQQDR7HK22QQZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:34:41.575" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:11.575" grpc.time_ms=1.062 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2587gitlab # [ 451.034584] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.662Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","289744eb4fee21d2005ee172"],"class":"WebHooks::LogExecutionWorker","jid":"d8e671d2a8da945b60b4965b","created_at":"2026-09-01T10:34:10.321Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-5573bcb3fdfc4c06","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:36d5487f3c4a7c300da79280b9ca098303e491784ca9ed84f7671bddc8f06251","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:10.329Z","job_size_bytes":2592,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d8e671d2a8da945b60b4965b: start","job_status":"start","queue_duration_s":1.332449,"scheduling_latency_s":1.33249}2588gitlab # [ 451.050967] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.698Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","289744eb4fee21d2005ee172"],"class":"WebHooks::LogExecutionWorker","jid":"d8e671d2a8da945b60b4965b","created_at":"2026-09-01T10:34:10.321Z","trace_propagation_headers":{"sentry-trace":"282bd006890f463a86f4e2c921de09cb-5573bcb3fdfc4c06","baggage":"sentry-trace_id=282bd006890f463a86f4e2c921de09cb,sentry-release=Unknown"},"correlation_id":"01M1E8EB36T06ZX5EWVGDC5G1N","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:36d5487f3c4a7c300da79280b9ca098303e491784ca9ed84f7671bddc8f06251","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:10.329Z","job_size_bytes":2592,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d8e671d2a8da945b60b4965b: done: 0.03605 sec","job_status":"done","queue_duration_s":1.332449,"scheduling_latency_s":1.33249,"redis_calls":7,"redis_duration_s":0.001225,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03605,"completed_at":"2026-09-01T10:34:11.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2589gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses, in 0.19 seconds)2590gitlab # [ 451.094229] gitaly[902]: time="2026-09-01T10:34:11.628Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H4PQW2AQQDR7HK22QQZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:41.626" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:11.627" grpc.time_ms=1.23 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2591gitlab # [ 451.106813] nix-daemon[3886]: accepted connection from pid 4543, user nixbot2592gitlab # [ 451.107732] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"d85075267dfabcbec18e0ad2","created_at":"2026-09-01T10:34:11.197Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-fa2bcf7ead0d4067","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.209Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-d85075267dfabcbec18e0ad2: start","job_status":"start","queue_duration_s":0.490673,"scheduling_latency_s":0.490696}2593gitlab # [ 451.124178] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.806Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"d85075267dfabcbec18e0ad2","created_at":"2026-09-01T10:34:11.197Z","trace_propagation_headers":{"sentry-trace":"044d6efecb6448ca9660ccdbf88f765c-fa2bcf7ead0d4067","baggage":"sentry-trace_id=044d6efecb6448ca9660ccdbf88f765c,sentry-release=Unknown"},"correlation_id":"01M1E8E3B9EXKM2M5B0T5XRE2C","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.209Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-d85075267dfabcbec18e0ad2: done: 0.106307 sec","job_status":"done","queue_duration_s":0.490673,"scheduling_latency_s":0.490696,"redis_calls":11,"redis_duration_s":0.002122,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00031,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003238,"duration_s":0.106307,"completed_at":"2026-09-01T10:34:11.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2594gitlab # [ 451.170244] gitaly[902]: time="2026-09-01T10:34:11.787Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H6V41KYJR4N82N12BVDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:41.785" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:11.785" grpc.time_ms=1.68 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2595gitlab # [ 451.182854] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1412596gitlab # [ 451.185536] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.807Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e7907ddc459de7538c4b68d2","created_at":"2026-09-01T10:34:11.293Z","trace_propagation_headers":{"sentry-trace":"9ee4b36f740a40678c13b112bfe39706-0a05082cd8ae4664","baggage":"sentry-trace_id=9ee4b36f740a40678c13b112bfe39706,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8H66MK2276YV5P2163WSK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.302Z","job_size_bytes":65,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e7907ddc459de7538c4b68d2: start","job_status":"start","queue_duration_s":0.505386,"scheduling_latency_s":0.505406}2597gitlab # [ 451.201993] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.841Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e7907ddc459de7538c4b68d2","created_at":"2026-09-01T10:34:11.293Z","trace_propagation_headers":{"sentry-trace":"9ee4b36f740a40678c13b112bfe39706-0a05082cd8ae4664","baggage":"sentry-trace_id=9ee4b36f740a40678c13b112bfe39706,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8H66MK2276YV5P2163WSK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.302Z","job_size_bytes":65,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e7907ddc459de7538c4b68d2: done: 0.033835 sec","job_status":"done","queue_duration_s":0.505386,"scheduling_latency_s":0.505406,"redis_calls":7,"redis_duration_s":0.001065,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033835,"completed_at":"2026-09-01T10:34:11.841Z","load_balancing_strategy":"primary","db_duration_s":0.004117,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2598gitlab # [ 451.244033] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.842Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"5a9a968643ef5c00eec518a4","created_at":"2026-09-01T10:34:11.303Z","trace_propagation_headers":{"sentry-trace":"9ee4b36f740a40678c13b112bfe39706-0a05082cd8ae4664","baggage":"sentry-trace_id=9ee4b36f740a40678c13b112bfe39706,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8H66MK2276YV5P2163WSK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.309Z","job_size_bytes":65,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-5a9a968643ef5c00eec518a4: start","job_status":"start","queue_duration_s":0.532929,"scheduling_latency_s":0.53295}2599gitlab # [ 451.260838] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.906Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"5a9a968643ef5c00eec518a4","created_at":"2026-09-01T10:34:11.303Z","trace_propagation_headers":{"sentry-trace":"9ee4b36f740a40678c13b112bfe39706-0a05082cd8ae4664","baggage":"sentry-trace_id=9ee4b36f740a40678c13b112bfe39706,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8H66MK2276YV5P2163WSK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.309Z","job_size_bytes":65,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-5a9a968643ef5c00eec518a4: done: 0.063943 sec","job_status":"done","queue_duration_s":0.532929,"scheduling_latency_s":0.53295,"redis_calls":10,"redis_duration_s":0.0032500000000000003,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001832,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001418,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063943,"completed_at":"2026-09-01T10:34:11.906Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015527,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2600gitlab # [ 451.304421] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.908Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2e6032afc05db700848d7b8f","created_at":"2026-09-01T10:34:11.374Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.378Z","job_size_bytes":23,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2e6032afc05db700848d7b8f: start","job_status":"start","queue_duration_s":0.530441,"scheduling_latency_s":0.530461}2601gitlab # [ 451.320691] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.959Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2e6032afc05db700848d7b8f","created_at":"2026-09-01T10:34:11.374Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.378Z","job_size_bytes":23,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2e6032afc05db700848d7b8f: done: 0.050888 sec","job_status":"done","queue_duration_s":0.530441,"scheduling_latency_s":0.530461,"redis_calls":7,"redis_duration_s":0.002081,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000582,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050888,"completed_at":"2026-09-01T10:34:11.959Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013086,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2602gitlab # [ 451.363535] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:11.961Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"97e8212bd937e14b18ac9e56","created_at":"2026-09-01T10:34:11.436Z","trace_propagation_headers":{"sentry-trace":"9ee4b36f740a40678c13b112bfe39706-0a05082cd8ae4664","baggage":"sentry-trace_id=9ee4b36f740a40678c13b112bfe39706,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8H66MK2276YV5P2163WSK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.442Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-97e8212bd937e14b18ac9e56: start","job_status":"start","queue_duration_s":0.519273,"scheduling_latency_s":0.519297}2603gitlab # [ 451.379469] gitaly[902]: time="2026-09-01T10:34:12.054Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:34:42.052" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:12.052" grpc.time_ms=1.325 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2604gitlab # [ 451.392370] gitaly[902]: time="2026-09-01T10:34:12.102Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H66MK2276YV5P2163WSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:42.100" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:12.101" grpc.time_ms=1.133 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2605gitlab # [ 451.404543] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.117Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"97e8212bd937e14b18ac9e56","created_at":"2026-09-01T10:34:11.436Z","trace_propagation_headers":{"sentry-trace":"9ee4b36f740a40678c13b112bfe39706-0a05082cd8ae4664","baggage":"sentry-trace_id=9ee4b36f740a40678c13b112bfe39706,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8H66MK2276YV5P2163WSK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.442Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-97e8212bd937e14b18ac9e56: done: 0.155781 sec","job_status":"done","queue_duration_s":0.519273,"scheduling_latency_s":0.519297,"gitaly_calls":2,"gitaly_duration_s":0.009175,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009451,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001374,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001412,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000362,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002583,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000287,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000693,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001366,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104237,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11600778,"duration_s":0.155781,"completed_at":"2026-09-01T10:34:12.117Z","load_balancing_strategy":"primary","db_duration_s":0.041756,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2606gitlab # [ 451.454863] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.119Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2ca514afb1ebf5eda9f5b2de","created_at":"2026-09-01T10:34:11.505Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.509Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2ca514afb1ebf5eda9f5b2de: start","job_status":"start","queue_duration_s":0.609461,"scheduling_latency_s":0.609483}2607gitlab # [ 451.471028] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.155Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2ca514afb1ebf5eda9f5b2de","created_at":"2026-09-01T10:34:11.505Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.509Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2ca514afb1ebf5eda9f5b2de: done: 0.036454 sec","job_status":"done","queue_duration_s":0.609461,"scheduling_latency_s":0.609483,"redis_calls":7,"redis_duration_s":0.0020340000000000002,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001471,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000563,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036454,"completed_at":"2026-09-01T10:34:12.155Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2608gitlab # [ 451.513820] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.157Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cf992f19f72849b672cdb7c9","created_at":"2026-09-01T10:34:11.519Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.523Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cf992f19f72849b672cdb7c9: start","job_status":"start","queue_duration_s":0.634467,"scheduling_latency_s":0.634488}2609gitlab # [ 451.529493] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.194Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cf992f19f72849b672cdb7c9","created_at":"2026-09-01T10:34:11.519Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.523Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cf992f19f72849b672cdb7c9: done: 0.037345 sec","job_status":"done","queue_duration_s":0.634467,"scheduling_latency_s":0.634488,"redis_calls":7,"redis_duration_s":0.002121,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001566,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037345,"completed_at":"2026-09-01T10:34:12.194Z","load_balancing_strategy":"primary","db_duration_s":0.009354,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2610gitlab # [ 451.571826] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.196Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"342d954812affd360ff6704a","created_at":"2026-09-01T10:34:11.534Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.537Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-342d954812affd360ff6704a: start","job_status":"start","queue_duration_s":0.659798,"scheduling_latency_s":0.659819}2611gitlab # [ 451.587372] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.237Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"342d954812affd360ff6704a","created_at":"2026-09-01T10:34:11.534Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.537Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-342d954812affd360ff6704a: done: 0.040556 sec","job_status":"done","queue_duration_s":0.659798,"scheduling_latency_s":0.659819,"redis_calls":10,"redis_duration_s":0.0029779999999999997,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001486,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000964,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000528,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040556,"completed_at":"2026-09-01T10:34:12.237Z","load_balancing_strategy":"primary","db_duration_s":0.010004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2612gitlab # [ 451.630637] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ef8d7f964572cd99f7d27eed","created_at":"2026-09-01T10:34:11.537Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.540Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ef8d7f964572cd99f7d27eed: start","job_status":"start","queue_duration_s":0.698929,"scheduling_latency_s":0.69895}2613gitlab # [ 451.647299] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.274Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ef8d7f964572cd99f7d27eed","created_at":"2026-09-01T10:34:11.537Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.540Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ef8d7f964572cd99f7d27eed: done: 0.034996 sec","job_status":"done","queue_duration_s":0.698929,"scheduling_latency_s":0.69895,"redis_calls":7,"redis_duration_s":0.00217,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034996,"completed_at":"2026-09-01T10:34:12.274Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2614gitlab # [ 451.689068] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.276Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f6156a22ad08714a39517785","created_at":"2026-09-01T10:34:11.540Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.543Z","job_size_bytes":19,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f6156a22ad08714a39517785: start","job_status":"start","queue_duration_s":0.732181,"scheduling_latency_s":0.732204}2615gitlab # [ 451.704879] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.307Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f6156a22ad08714a39517785","created_at":"2026-09-01T10:34:11.540Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.543Z","job_size_bytes":19,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f6156a22ad08714a39517785: done: 0.031452 sec","job_status":"done","queue_duration_s":0.732181,"scheduling_latency_s":0.732204,"redis_calls":8,"redis_duration_s":0.002365,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001841,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031452,"completed_at":"2026-09-01T10:34:12.307Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2616gitlab # [ 451.746508] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.309Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dfd0a1e563b158d36a1abde2","created_at":"2026-09-01T10:34:11.545Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.547Z","job_size_bytes":66,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dfd0a1e563b158d36a1abde2: start","job_status":"start","queue_duration_s":0.761684,"scheduling_latency_s":0.761704}2617gitlab # [ 451.763635] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.336Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dfd0a1e563b158d36a1abde2","created_at":"2026-09-01T10:34:11.545Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.547Z","job_size_bytes":66,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dfd0a1e563b158d36a1abde2: done: 0.026834 sec","job_status":"done","queue_duration_s":0.761684,"scheduling_latency_s":0.761704,"redis_calls":7,"redis_duration_s":0.001963,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001416,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000547,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026834,"completed_at":"2026-09-01T10:34:12.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2618gitlab # [ 451.807615] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.338Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3edbd079f8978324918b4752","created_at":"2026-09-01T10:34:11.548Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.550Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3edbd079f8978324918b4752: start","job_status":"start","queue_duration_s":0.787443,"scheduling_latency_s":0.787461}2619gitlab # [ 451.823816] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.369Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3edbd079f8978324918b4752","created_at":"2026-09-01T10:34:11.548Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.550Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3edbd079f8978324918b4752: done: 0.031802 sec","job_status":"done","queue_duration_s":0.787443,"scheduling_latency_s":0.787461,"redis_calls":7,"redis_duration_s":0.001958,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031802,"completed_at":"2026-09-01T10:34:12.369Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2620gitlab # [ 451.865697] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.371Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"be66fe8ca37653ee67a5f505","created_at":"2026-09-01T10:34:11.551Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.553Z","job_size_bytes":6,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-be66fe8ca37653ee67a5f505: start","job_status":"start","queue_duration_s":0.818045,"scheduling_latency_s":0.818065}2621gitlab # [ 451.881329] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.387Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"be66fe8ca37653ee67a5f505","created_at":"2026-09-01T10:34:11.551Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.553Z","job_size_bytes":6,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-be66fe8ca37653ee67a5f505: done: 0.016252 sec","job_status":"done","queue_duration_s":0.818045,"scheduling_latency_s":0.818065,"redis_calls":7,"redis_duration_s":0.0018499999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001357,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000493,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016252,"completed_at":"2026-09-01T10:34:12.387Z","load_balancing_strategy":"primary","db_duration_s":0.000765,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2622gitlab # [ 451.922616] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.389Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"983301eb1be19dd4e95eb705","created_at":"2026-09-01T10:34:11.554Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.556Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-983301eb1be19dd4e95eb705: start","job_status":"start","queue_duration_s":0.833107,"scheduling_latency_s":0.833124}2623gitlab # [ 451.937845] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.418Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"983301eb1be19dd4e95eb705","created_at":"2026-09-01T10:34:11.554Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.556Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-983301eb1be19dd4e95eb705: done: 0.029075 sec","job_status":"done","queue_duration_s":0.833107,"scheduling_latency_s":0.833124,"redis_calls":7,"redis_duration_s":0.001945,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029075,"completed_at":"2026-09-01T10:34:12.418Z","load_balancing_strategy":"primary","db_duration_s":0.00634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2624gitlab # [ 451.979762] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.420Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"a9a485083b423d0acd7c6a77","created_at":"2026-09-01T10:34:11.646Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.649Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a9a485083b423d0acd7c6a77: start","job_status":"start","queue_duration_s":0.770446,"scheduling_latency_s":0.770465}2625gitlab # [ 451.995302] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.452Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"a9a485083b423d0acd7c6a77","created_at":"2026-09-01T10:34:11.646Z","trace_propagation_headers":{"sentry-trace":"25da20311b354e8f9a38a1db5c7bfd8f-3c120efbedb34c3c","baggage":"sentry-trace_id=25da20311b354e8f9a38a1db5c7bfd8f,sentry-release=Unknown"},"correlation_id":"01M1E8H4PQW2AQQDR7HK22QQZD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:11.649Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a9a485083b423d0acd7c6a77: done: 0.032617 sec","job_status":"done","queue_duration_s":0.770446,"scheduling_latency_s":0.770465,"redis_calls":8,"redis_duration_s":0.0022779999999999996,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0017,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000578,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032617,"completed_at":"2026-09-01T10:34:12.452Z","load_balancing_strategy":"primary","db_duration_s":0.007334,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2626gitlab # [ 452.037370] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.454Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"5feaa89c78ee28ebf490aff7","created_at":"2026-09-01T10:34:12.032Z","trace_propagation_headers":{"sentry-trace":"9ee4b36f740a40678c13b112bfe39706-b9c12e1f1ae2443f","baggage":"sentry-trace_id=9ee4b36f740a40678c13b112bfe39706,sentry-release=Unknown"},"correlation_id":"01M1E8H66MK2276YV5P2163WSK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:12.035Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5feaa89c78ee28ebf490aff7: start","job_status":"start","queue_duration_s":0.418897,"scheduling_latency_s":0.418914}2627gitlab # [ 452.053299] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:12.494Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"5feaa89c78ee28ebf490aff7","created_at":"2026-09-01T10:34:12.032Z","trace_propagation_headers":{"sentry-trace":"9ee4b36f740a40678c13b112bfe39706-b9c12e1f1ae2443f","baggage":"sentry-trace_id=9ee4b36f740a40678c13b112bfe39706,sentry-release=Unknown"},"correlation_id":"01M1E8H66MK2276YV5P2163WSK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:12.035Z","job_size_bytes":3,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5feaa89c78ee28ebf490aff7: done: 0.040287 sec","job_status":"done","queue_duration_s":0.418897,"scheduling_latency_s":0.418914,"redis_calls":7,"redis_duration_s":0.0018609999999999998,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040287,"completed_at":"2026-09-01T10:34:12.494Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2628gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses2629gitlab # [ 452.273411] gitaly[902]: time="2026-09-01T10:34:12.999Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H81R1Y38V2PMJW5CY2H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:42.697" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:12.998" grpc.time_ms=1.352 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2630gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses, in 0.22 seconds)2631gitlab # [ 452.324364] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1292632gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses2633gitlab # [ 453.492476] gitaly[902]: time="2026-09-01T10:34:14.219Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8H96Z14NN97WGPYMKY67Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:44.216" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:14.217" grpc.time_ms=1.475 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2634gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses, in 0.23 seconds)2635gitlab # [ 453.549338] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:14 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1642636gitlab # [ 453.625979] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:14.351Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1b8ccc401a5ad5835eb747e3","created_at":"2026-09-01T10:34:14.324Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"553532797e2c9cf8e00827047aa32aec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.347Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1b8ccc401a5ad5835eb747e3: start","job_status":"start","queue_duration_s":0.003402,"scheduling_latency_s":0.003462}2637gitlab # [ 453.788721] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:14.514Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1b8ccc401a5ad5835eb747e3","created_at":"2026-09-01T10:34:14.324Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"553532797e2c9cf8e00827047aa32aec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.347Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1b8ccc401a5ad5835eb747e3: done: 0.163443 sec","job_status":"done","queue_duration_s":0.003402,"scheduling_latency_s":0.003462,"redis_calls":11,"redis_duration_s":0.029718,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.006758,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00414,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.163443,"completed_at":"2026-09-01T10:34:14.514Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2638gitlab # [ 453.887120] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:14.519Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"30eaf5fb30c4920fd9bcf24d","created_at":"2026-09-01T10:34:14.371Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d8b0f974b3392bf98fe0e1d055f9a60","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.387Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-30eaf5fb30c4920fd9bcf24d: start","job_status":"start","queue_duration_s":0.1325,"scheduling_latency_s":0.132561}2639gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses2640gitlab # [ 454.726793] gitaly[902]: time="2026-09-01T10:34:15.453Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8HADG6EWYPFCDGBY29EQ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:45.150" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:15.451" grpc.time_ms=1.359 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2641gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses, in 0.24 seconds)2642gitlab # [ 454.785561] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1662643gitlab # [ 455.494977] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"30eaf5fb30c4920fd9bcf24d","created_at":"2026-09-01T10:34:14.371Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d8b0f974b3392bf98fe0e1d055f9a60","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.387Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-30eaf5fb30c4920fd9bcf24d: done: 1.70135 sec","job_status":"done","queue_duration_s":0.1325,"scheduling_latency_s":0.132561,"redis_calls":564,"redis_duration_s":1.062914,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004784,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.052417,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.730675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.70135,"completed_at":"2026-09-01T10:34:16.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2644gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses2645gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses, in 0.18 seconds)2646gitlab # [ 455.495586] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"bb21e7039aff55bd82312635","created_at":"2026-09-01T10:34:14.423Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37d6cf38e5c24bd64db10317e51dced4","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.450Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-bb21e7039aff55bd82312635: start","job_status":"start","queue_duration_s":1.773009,"scheduling_latency_s":1.773039}2647gitlab # [ 455.578901] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"bb21e7039aff55bd82312635","created_at":"2026-09-01T10:34:14.423Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37d6cf38e5c24bd64db10317e51dced4","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.450Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-bb21e7039aff55bd82312635: done: 0.04219 sec","job_status":"done","queue_duration_s":1.773009,"scheduling_latency_s":1.773039,"redis_calls":9,"redis_duration_s":0.002875,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000607,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04219,"completed_at":"2026-09-01T10:34:16.265Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007066,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2648gitlab # [ 456.297655] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d81bc3991ccbd63954b1e587","created_at":"2026-09-01T10:34:14.484Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5384b8e7c463fbe360ef1c49b743c960","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.565Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d81bc3991ccbd63954b1e587: start","job_status":"start","queue_duration_s":1.701409,"scheduling_latency_s":1.701437}2649gitlab # [ 456.298397] nix-daemon[3886]: accepted connection from pid 4576, user nixbot2650gitlab # [ 456.298473] nix-daemon[3886]: accepted connection from pid 4543, user nixbot2651gitlab # [ 456.298915] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1252652gitlab # [ 456.299343] gitaly[902]: time="2026-09-01T10:34:16.646Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8HBKR7BGS265R58G4T1HQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:46.343" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:16.644" grpc.time_ms=2.121 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2653gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses2654gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses, in 0.21 seconds)2655gitlab # [ 456.299485] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.300Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d81bc3991ccbd63954b1e587","created_at":"2026-09-01T10:34:14.484Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5384b8e7c463fbe360ef1c49b743c960","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.565Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d81bc3991ccbd63954b1e587: done: 0.03346 sec","job_status":"done","queue_duration_s":1.701409,"scheduling_latency_s":1.701437,"redis_calls":11,"redis_duration_s":0.003535,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000663,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001508,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001364,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00075778,"exclusive_lock_hold_duration_s":0.0052624,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.03346,"completed_at":"2026-09-01T10:34:16.300Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003129,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2656gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses2657gitlab # [ 456.970433] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.302Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3b5419664e011cf589016222","created_at":"2026-09-01T10:34:14.589Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbcef5c15f0451564e85710fa2603c3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.612Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3b5419664e011cf589016222: start","job_status":"start","queue_duration_s":1.689882,"scheduling_latency_s":1.689906}2658gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses, in 0.22 seconds)2659gitlab # [ 457.638142] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3b5419664e011cf589016222","created_at":"2026-09-01T10:34:14.589Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbcef5c15f0451564e85710fa2603c3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.612Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3b5419664e011cf589016222: done: 0.026749 sec","job_status":"done","queue_duration_s":1.689882,"scheduling_latency_s":1.689906,"redis_calls":9,"redis_duration_s":0.002627,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000709,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026749,"completed_at":"2026-09-01T10:34:16.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2660gitlab # [ 458.350183] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0cfd5e67ab44fa972d8b9db1","created_at":"2026-09-01T10:34:14.638Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19baf4fe1822b0dac4a5f53fd7a8b716","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.659Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0cfd5e67ab44fa972d8b9db1: start","job_status":"start","queue_duration_s":1.671443,"scheduling_latency_s":1.671464}2661gitlab # [ 458.350827] gitaly[902]: time="2026-09-01T10:34:17.865Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8HCRV0V0EY02NR95F303J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:47.562" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:17.863" grpc.time_ms=1.185 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2662gitlab # [ 458.351280] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1442663gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses2664gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses, in 0.22 seconds)2665gitlab # [ 458.351394] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.468Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0cfd5e67ab44fa972d8b9db1","created_at":"2026-09-01T10:34:14.638Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19baf4fe1822b0dac4a5f53fd7a8b716","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.659Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0cfd5e67ab44fa972d8b9db1: done: 0.137421 sec","job_status":"done","queue_duration_s":1.671443,"scheduling_latency_s":1.671464,"redis_calls":13,"redis_duration_s":0.00594,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002457,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001611,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001872,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00144192,"exclusive_lock_hold_duration_s":0.09060128,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.137421,"completed_at":"2026-09-01T10:34:16.468Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2666gitlab # [ 459.076800] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"c4bbcdc1f08f77baa3a03ddd","created_at":"2026-09-01T10:34:14.696Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fffd81d6711ffb5e2f4d4c9d076860b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.727Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-c4bbcdc1f08f77baa3a03ddd: start","job_status":"start","queue_duration_s":1.743814,"scheduling_latency_s":1.743849}2667gitlab # [ 459.792191] gitaly[902]: time="2026-09-01T10:34:19.050Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8HDYEWEQ81J6VFCJWDSJV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:49.049" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:19.049" grpc.time_ms=1.034 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2668gitlab # [ 459.792732] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1602669gitlab # [ 459.792791] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1582670gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses2671gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses, in 0.24 seconds)2672gitlab # [ 459.793233] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.550Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"c4bbcdc1f08f77baa3a03ddd","created_at":"2026-09-01T10:34:14.696Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fffd81d6711ffb5e2f4d4c9d076860b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.727Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-c4bbcdc1f08f77baa3a03ddd: done: 0.079759 sec","job_status":"done","queue_duration_s":1.743814,"scheduling_latency_s":1.743849,"redis_calls":12,"redis_duration_s":0.0057079999999999995,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000924,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002877,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001907,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02310984,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.079759,"completed_at":"2026-09-01T10:34:16.550Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006056,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2673gitlab # [ 460.517033] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.554Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3aafe01e30946d944b57a43a","created_at":"2026-09-01T10:34:14.775Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4bbb54ee790c3019e830ee9c94ebb85","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:34:14.801Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3aafe01e30946d944b57a43a: start","job_status":"start","queue_duration_s":1.752863,"scheduling_latency_s":1.75291}2674gitlab # [ 460.517218] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.587Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2675gitlab # [ 460.517379] gitaly[902]: time="2026-09-01T10:34:20.290Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8HF4NB26862QVAEPQSE6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:50.287" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:20.288" grpc.time_ms=1.307 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2676gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses2677gitlab # [ 461.177254] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3aafe01e30946d944b57a43a","created_at":"2026-09-01T10:34:14.775Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4bbb54ee790c3019e830ee9c94ebb85","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:34:14.801Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3aafe01e30946d944b57a43a: done: 0.053075 sec","job_status":"done","queue_duration_s":1.752863,"scheduling_latency_s":1.75291,"redis_calls":9,"redis_duration_s":0.0044480000000000006,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000953,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002599,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053075,"completed_at":"2026-09-01T10:34:16.607Z","load_balancing_strategy":"primary","db_duration_s":0.001059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2678gitlab # [ 461.177407] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"44db57a7d173d85d01c36a56","created_at":"2026-09-01T10:34:14.845Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a398a532b4386c78a72d4d4c29372208","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.868Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-44db57a7d173d85d01c36a56: start","job_status":"start","queue_duration_s":1.742178,"scheduling_latency_s":1.742222}2679gitlab # [ 461.909909] nix-daemon[3886]: accepted connection from pid 4543, user nixbot2680gitlab # [ 461.910564] gitaly[902]: time="2026-09-01T10:34:21.130Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8HFYS8MR3WSWFCX6SF8RC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:51.127" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:34:21.128" grpc.time_ms=1.38 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2681gitlab # [ 461.911158] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3232682gitlab # [ 461.911228] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses HTTP/1.1" 200 671 "" "curl/8.21.0" 1812683gitlab # [ 461.911282] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3242684gitlab # [ 461.911333] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/096a5e830794ee3f155bc4093c8cc84aa73a8ef8 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2342685gitlab # [ 461.911402] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1272686gitlab # [ 461.911456] gitlab-workhorse[817]: time="2026-09-01T10:34:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672687gitlab # [ 461.911506] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/01:10:34:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1152688gitlab # [ 461.912009] nixbot[3646]: {"ts": "2026-09-01T10:34:21.344Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/096a5e830794ee3f155bc4093c8cc84aa73a8ef8 \"HTTP/1.1 201 Created\""}2689gitlab # [ 461.966861] nixbot[3646]: {"ts": "2026-09-01T10:34:21.680Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/096a5e830794ee3f155bc4093c8cc84aa73a8ef8 \"HTTP/1.1 201 Created\""}2690gitlab # [ 461.969788] nixbot[3646]: {"ts": "2026-09-01T10:34:21.934Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/096a5e830794ee3f155bc4093c8cc84aa73a8ef8 \"HTTP/1.1 201 Created\""}2691gitlab # [ 461.972657] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.681Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"44db57a7d173d85d01c36a56","created_at":"2026-09-01T10:34:14.845Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a398a532b4386c78a72d4d4c29372208","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.868Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-44db57a7d173d85d01c36a56: done: 0.070741 sec","job_status":"done","queue_duration_s":1.742178,"scheduling_latency_s":1.742222,"redis_calls":9,"redis_duration_s":0.003871,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000811,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000833,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.070741,"completed_at":"2026-09-01T10:34:16.681Z","load_balancing_strategy":"primary","db_duration_s":0.020457,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2692gitlab # [ 462.015149] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.683Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"35d5cb128afd8ae994c418f4","created_at":"2026-09-01T10:34:14.916Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95f1b953b79848b0677c4534bbfe8f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.936Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-35d5cb128afd8ae994c418f4: start","job_status":"start","queue_duration_s":1.747422,"scheduling_latency_s":1.74746}2693gitlab # [ 462.029403] gitaly[902]: time="2026-09-01T10:34:21.220Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8HFYS8MR3WSWFCX6SF8RC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:34:31.120" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:34:21.201" grpc.time_ms=18.477 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2694gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/096a5e830794ee3f155bc4093c8cc84aa73a8ef8/statuses, in 0.21 seconds)2695(finished: subtest: eval and build post commit statuses, in 11.15 seconds)2696(finished: run the VM test script, in 538.55 seconds)2697gitlab # [ 462.044143] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"35d5cb128afd8ae994c418f4","created_at":"2026-09-01T10:34:14.916Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95f1b953b79848b0677c4534bbfe8f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.936Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-35d5cb128afd8ae994c418f4: done: 0.071156 sec","job_status":"done","queue_duration_s":1.747422,"scheduling_latency_s":1.74746,"redis_calls":9,"redis_duration_s":0.005799,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001219,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003443,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001137,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.071156,"completed_at":"2026-09-01T10:34:16.754Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2698gitlab # [ 462.086748] sidekiq-cluster[3596]: {"severity":"INFO","time":"2026-09-01T10:34:16.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e011e3f7537e7b5d61727e59","created_at":"2026-09-01T10:34:14.972Z","trace_propagation_headers":{"sentry-trace":"07a75e9549aa4d7b8115ee1a2129d912-3ce01a1e936f4864","baggage":"sentry-trace_id=07a75e9549aa4d7b8115ee1a2129d912,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9ecf31bbba9582ccf96f3247657ab0b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:14.993Z","job_size_bytes":2,"pid":3596,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e011e3f7537e7b5d61727e59: start","job_status":"start","queue_duration_s":1.765383,"scheduling_latency_s":1.765431}2699test script finished in 538.59s2700cleanup2701kill QemuMachine (pid 46)2702gitlab # [ 462.103429] gitaly[902]: time="2026-09-01T10:34:21.483Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8HG99W2D724RJWH99P5C6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:34:51.482" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2703gitlab # f2704(finished: cleanup, in 1.66 seconds)2705additionally exposed symbols:2706 gitlab,2707 vlan1,2708 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2709[]2710[]2711[]2712[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-01T10:32:36.673Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2713[]2714[]2715[]2716[]2717[]2718[]2719[]2720[]2721[]2722[]2723[]2724[]2725[]2726[]2727[]2728[]2729[]2730[]2731[]2732[]2733[]2734[]2735[]2736[]2737[]2738[]2739[]2740[]2741[]2742[]2743[]2744[]2745[]2746[]2747[]2748[]2749[]2750[]2751[]2752[]2753[]2754[]2755[]2756[]2757[]2758[]2759[]2760[]2761[]2762[]2763[]2764[]2765[]2766[]2767[]2768[]2769[]2770[]2771[]2772[]2773[]2774[]2775[]2776[]2777[]2778[]2779[]2780[]2781[]2782[]2783[]2784[]2785[]2786[]2787[]2788[]2789[]2790[]2791[]2792[]2793[]2794[]2795[]2796[]2797[]2798[]2799[]2800[]2801[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-01T10:34:11.022569Z', 'started_at': '2026-09-01T10:34:11.474390Z', 'finished_at': None, 'eval_queue': None}]2802[{'id': 5, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:34:11.423Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2803[{'id': 5, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:34:11.423Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2804[{'id': 5, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:34:11.423Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2805[{'id': 5, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:34:11.423Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2806[{'id': 5, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:34:11.423Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2807[{'id': 5, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:34:11.423Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2808[{'id': 5, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:34:11.423Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2809[{'id': 5, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:34:11.423Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2810[{'id': 5, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-09-01T10:34:11.423Z', 'started_at': None, 'finished_at': '2026-09-01T10:34:21.277Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2811[{'id': 5, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-09-01T10:34:11.423Z', 'started_at': None, 'finished_at': '2026-09-01T10:34:21.277Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '096a5e830794ee3f155bc4093c8cc84aa73a8ef8', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-01T10:34:21.626Z', 'started_at': None, 'finished_at': '2026-09-01T10:34:21.885Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]