vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #379
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.cz7TaO43K3', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 46.28 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: a8658b81-9b5d-4a74-b8ff-fce6fb834b6d19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1nzc3cy421hl4jsb2m04vqfhwc1br877-nixos-system-gitlab-test/init regInfo=/nix/store/1jjjx0mh4iafmjvl17xbmmg45jf1k4zl-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 517690644 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000004] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000810] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000877] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002736] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002748] Using GB pages for direct mapping73gitlab # [ 0.002844] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002854] ACPI: Early table checksum verification disabled75gitlab # [ 0.002856] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002860] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002864] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002871] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002873] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002875] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002877] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002878] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002880] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002880] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002881] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002881] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002882] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002882] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003120] No NUMA configuration found90gitlab # [ 0.003121] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003123] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005460] Zone ranges:93gitlab # [ 0.005461] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005462] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005463] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005465] Device empty97gitlab # [ 0.005465] Movable zone start for each node98gitlab # [ 0.005466] Early memory node ranges99gitlab # [ 0.005466] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005467] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005468] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005469] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005489] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005763] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.115990] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.116425] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.116441] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.116477] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.116480] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.116482] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.116483] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.116485] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.116485] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.116488] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.116489] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.116494] TSC deadline timer available117gitlab # [ 0.116499] CPU topo: Max. logical packages: 1118gitlab # [ 0.116500] CPU topo: Max. logical dies: 1119gitlab # [ 0.116500] CPU topo: Max. dies per package: 1120gitlab # [ 0.116503] CPU topo: Max. threads per core: 1121gitlab # [ 0.116504] CPU topo: Num. cores per package: 4122gitlab # [ 0.116504] CPU topo: Num. threads per package: 4123gitlab # [ 0.116505] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.116531] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.116550] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.116552] kvm-guest: setup PV sched yield127gitlab # [ 0.116571] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.116573] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.116574] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.116576] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.116577] Booting paravirtualized kernel on KVM132gitlab # [ 0.116581] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.121177] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.123719] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.123772] kvm-guest: PV spinlocks enabled136gitlab # [ 0.123774] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.123777] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1nzc3cy421hl4jsb2m04vqfhwc1br877-nixos-system-gitlab-test/init regInfo=/nix/store/1jjjx0mh4iafmjvl17xbmmg45jf1k4zl-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.123877] Unknown kernel command line parameters "regInfo=/nix/store/1jjjx0mh4iafmjvl17xbmmg45jf1k4zl-closure-info/registration", will be passed to user space.139gitlab # [ 0.123890] random: crng init done140gitlab # [ 0.123891] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.132934] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.137329] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.137403] software IO TLB: area num 4.144gitlab # [ 0.210739] Fallback order for Node 0: 0145gitlab # [ 0.210747] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.210749] Policy zone: Normal147gitlab # [ 0.213338] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.223793] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.236722] allocated 12582912 bytes of page_ext150gitlab # [ 0.246954] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.246956] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.247868] Dynamic Preempt: lazy153gitlab # [ 0.248035] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.248035] rcu: RCU event tracing is enabled.155gitlab # [ 0.248036] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.248038] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.248039] Rude variant of Tasks RCU enabled.158gitlab # [ 0.248039] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.248039] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.248040] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.248056] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.248057] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.248058] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.252604] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.252899] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.252909] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.253021] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.256586] Console: colour VGA+ 80x25169gitlab # [ 0.256590] printk: legacy console [tty0] enabled170gitlab # [ 0.286960] printk: legacy console [ttyS0] enabled171gitlab # [ 0.394864] ACPI: Core revision 20250807172gitlab # [ 0.395892] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.397509] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.398524] x2apic enabled175gitlab # [ 0.399267] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.400234] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.401516] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.403057] kvm-guest: setup PV IPIs179gitlab # [ 0.404658] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.405728] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.407555] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.408640] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.409675] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.411552] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.412556] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.413552] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.414552] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.416339] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.417315] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.418365] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.419560] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.420553] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.421553] active return thunk: srso_alias_return_thunk194gitlab # [ 0.422574] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.423552] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.425552] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.426552] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.427551] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.428552] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.429551] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.430552] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.432356] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.433349] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.434351] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.435356] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.436552] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.466852] Freeing SMP alternatives memory: 44K208gitlab # [ 0.467555] pid_max: default: 32768 minimum: 301209gitlab # [ 0.468651] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.469667] landlock: Up and running.211gitlab # [ 0.470322] Yama: becoming mindful.212gitlab # [ 0.471223] LSM support for eBPF active213gitlab # [ 0.472276] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.473719] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.476263] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.477106] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.477556] ... version: 2218gitlab # [ 0.478297] ... bit width: 48219gitlab # [ 0.478554] ... generic counters: 6220gitlab # [ 0.479326] ... generic bitmap: 000000000000003f221gitlab # [ 0.479601] ... fixed-purpose counters: 0222gitlab # [ 0.480373] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.481271] ... value mask: 0000ffffffffffff224gitlab # [ 0.481554] ... max period: 00007fffffffffff225gitlab # [ 0.482472] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.483403] signal: max sigframe size: 3376227gitlab # [ 0.484164] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.484557] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.485631] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.491162] smp: Bringing up secondary CPUs ...231gitlab # [ 0.491956] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.492563] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.495652] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.497263] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.498039] Memory: 6011396K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.499555] devtmpfs: initialized237gitlab # [ 0.500577] x86/mm: Memory block size: 128MB238gitlab # [ 0.503626] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.504630] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.505650] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.506793] PM: RTC time: 08:34:15, date: 2026-09-14242gitlab # [ 0.510927] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.512845] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.513619] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.515611] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.516569] audit: initializing netlink subsys (disabled)247gitlab # [ 0.517741] audit: type=2000 audit(1789374855.759:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.517874] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.519554] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.520554] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.521538] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.522326] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.522568] cpuidle: using governor menu254gitlab # [ 0.524759] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.525874] PCI: Using configuration type 1 for base access256gitlab # [ 0.526555] PCI: Using configuration type 1 for extended access257gitlab # [ 0.527693] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.530680] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.531555] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.532554] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.533554] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.538536] ACPI: Added _OSI(Module Device)263gitlab # [ 0.540561] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.542563] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.549565] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.559814] ACPI: Interpreter enabled267gitlab # [ 0.560580] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.561409] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.562933] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.566559] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.570172] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.583268] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.586570] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.590884] acpiphp: Slot [3] registered275gitlab # [ 0.592669] acpiphp: Slot [4] registered276gitlab # [ 0.594662] acpiphp: Slot [5] registered277gitlab # [ 0.596687] acpiphp: Slot [6] registered278gitlab # [ 0.597641] acpiphp: Slot [7] registered279gitlab # [ 0.599635] acpiphp: Slot [8] registered280gitlab # [ 0.600627] acpiphp: Slot [9] registered281gitlab # [ 0.602649] acpiphp: Slot [10] registered282gitlab # [ 0.603635] acpiphp: Slot [11] registered283gitlab # [ 0.605642] acpiphp: Slot [12] registered284gitlab # [ 0.606633] acpiphp: Slot [13] registered285gitlab # [ 0.607431] acpiphp: Slot [14] registered286gitlab # [ 0.608598] acpiphp: Slot [15] registered287gitlab # [ 0.609596] acpiphp: Slot [16] registered288gitlab # [ 0.611622] acpiphp: Slot [17] registered289gitlab # [ 0.612595] acpiphp: Slot [18] registered290gitlab # [ 0.613304] acpiphp: Slot [19] registered291gitlab # [ 0.614575] acpiphp: Slot [20] registered292gitlab # [ 0.615261] acpiphp: Slot [21] registered293gitlab # [ 0.615574] acpiphp: Slot [22] registered294gitlab # [ 0.616286] acpiphp: Slot [23] registered295gitlab # [ 0.617575] acpiphp: Slot [24] registered296gitlab # [ 0.618264] acpiphp: Slot [25] registered297gitlab # [ 0.618574] acpiphp: Slot [26] registered298gitlab # [ 0.619306] acpiphp: Slot [27] registered299gitlab # [ 0.619586] acpiphp: Slot [28] registered300gitlab # [ 0.620269] acpiphp: Slot [29] registered301gitlab # [ 0.621574] acpiphp: Slot [30] registered302gitlab # [ 0.622253] acpiphp: Slot [31] registered303gitlab # [ 0.622567] PCI host bridge to bus 0000:00304gitlab # [ 0.623274] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.624558] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.625554] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.626563] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.627557] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.629556] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.630765] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.632147] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.634030] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.637304] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.638583] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.639554] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.640545] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.641402] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.642515] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.645583] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.648341] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.649853] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.651616] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.654105] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.666646] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.667568] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.668576] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.669737] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.672334] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.676593] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.677516] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.679464] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.691563] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.694660] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.700591] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.701475] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.702314] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.704744] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.709807] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.711223] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.712576] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.714804] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.717591] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.718436] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.719289] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.722788] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.727593] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.728587] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.729577] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.733628] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.737590] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.738502] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.739377] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.741790] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.745487] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.746238] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.747576] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.748561] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.750789] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.754596] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.755583] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.758789] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.762613] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.763515] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.766618] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.773281] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.786598] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.788585] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.790613] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.803974] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.806960] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.809915] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.811895] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.814710] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.818797] iommu: Default domain type: Translated375gitlab # [ 0.820561] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.823060] ACPI: bus type USB registered377gitlab # [ 0.824666] usbcore: registered new interface driver usbfs378gitlab # [ 0.826606] usbcore: registered new interface driver hub379gitlab # [ 0.828606] usbcore: registered new device driver usb380gitlab # [ 0.830850] NetLabel: Initializing381gitlab # [ 0.831470] NetLabel: domain hash size = 128382gitlab # [ 0.832127] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.834747] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.836580] PCI: Using ACPI for IRQ routing385gitlab # [ 0.839772] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.840551] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.840551] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.847596] vgaarb: loaded389gitlab # [ 0.850096] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.851558] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.858009] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.861479] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.863264] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.866560] pnp: PnP ACPI init395gitlab # [ 0.869470] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.880713] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.882362] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.883544] NET: Registered PF_INET protocol family399gitlab # [ 0.885671] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.903536] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.905114] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.906543] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.910251] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.911617] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.912880] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.914507] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.915973] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.917372] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.918424] NET: Registered PF_XDP protocol family410gitlab # [ 0.919317] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.920385] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.921413] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.922625] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.923813] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.925188] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.926211] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.928748] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.931315] PCI: CLS 0 bytes, default 64419gitlab # [ 0.932162] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.932833] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.933273] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.936114] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 0.956878] Initialise system trusted keyrings424gitlab # [ 0.958225] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.969795] Key type asymmetric registered426gitlab # [ 0.970528] Asymmetric key parser 'x509' registered427gitlab # [ 0.971493] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.973181] io scheduler mq-deadline registered429gitlab # [ 0.974032] io scheduler kyber registered430gitlab # [ 0.979053] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.980422] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.982863] Linux agpgart interface v0.103433gitlab # [ 0.983690] ACPI: bus type drm_connector registered434gitlab # [ 0.986111] usbcore: registered new interface driver usbserial_generic435gitlab # [ 0.987248] usbserial: USB Serial support registered for generic436gitlab # [ 0.988279] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 0.988279] Please enable it if your BIOS has the CPPC option.438gitlab # [ 0.990676] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 0.992118] drop_monitor: Initializing network drop monitor service440gitlab # [ 0.993364] NET: Registered PF_INET6 protocol family441gitlab # [ 0.995999] Segment Routing with IPv6442gitlab # [ 0.996774] In-situ OAM (IOAM) with IPv6443gitlab # [ 0.999065] IPI shorthand broadcast: enabled444gitlab # [ 1.003611] sched_clock: Marking stable (856011208, 146642137)->(1026575527, -23922182)445gitlab # [ 1.005466] registered taskstats version 1446gitlab # [ 1.006481] Loading compiled-in X.509 certificates447gitlab # [ 1.016146] Demotion targets for Node 0: null448gitlab # [ 1.017266] Key type .fscrypt registered449gitlab # [ 1.018008] Key type fscrypt-provisioning registered450gitlab # [ 1.019062] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.020035] ima: Allocated hash algorithm: sha1452gitlab # [ 1.020888] ima: No architecture policies found453gitlab # [ 1.022128] PM: Magic number: 10:945:573454gitlab # [ 1.023881] RAS: Correctable Errors collector initialized.455gitlab # [ 1.028410] clk: Disabling unused clocks456gitlab # [ 1.029134] PM: genpd: Disabling unused power domains457gitlab # [ 1.212437] Freeing initrd memory: 29392K458gitlab # [ 1.216123] Freeing unused decrypted memory: 2028K459gitlab # [ 1.219002] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.220190] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.222482] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.224216] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.275270] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.276420] Run /init as init process465gitlab # [ 1.287980] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.309400] fuse: init (API version 7.45)467gitlab # [ 1.318027] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.324924] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.328196] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.367546] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.704301] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.744400] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.746628] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.748861] systemd[1]: Running in initrd.475gitlab # [ 1.751315] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.754284] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.866042] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.911526] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.921360] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.922538] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.924088] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.925286] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.926415] systemd[1]: Reached target Path Units.484gitlab # [ 1.927320] systemd[1]: Reached target Slice Units.485gitlab # [ 1.928243] systemd[1]: Reached target Swaps.486gitlab # [ 1.929083] systemd[1]: Reached target Timer Units.487gitlab # [ 1.930124] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.931394] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.932542] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.933566] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.934574] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.935527] systemd[1]: Reached target Socket Units.493gitlab # [ 1.937569] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.939612] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.941911] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 1.945735] systemd[1]: Starting Journal Service...497gitlab # [ 1.949745] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 1.950765] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 1.963052] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 1.974553] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 1.976722] systemd-journald[92]: Collecting audit messages is disabled.502gitlab # [ 1.982278] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 1.990817] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 1.994298] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.001811] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.009830] netfs: FS-Cache loaded507gitlab # [ 2.013878] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.508gitlab # [ 2.019819] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev509gitlab # [ 2.020380] 9pnet: Installing 9P2000 support510gitlab # [ 2.022599] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.511gitlab # [ 2.024781] systemd[1]: Finished Load Kernel Modules.512gitlab # [ 2.027803] systemd[1]: Starting Apply Kernel Variables...513gitlab # [ 2.029876] systemd[1]: Starting Create Static Device Nodes in /dev...514gitlab # [ 2.031357] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.515gitlab # [ 2.042179] systemd[1]: Finished Load Kernel Module 9pnet_virtio.516gitlab # [ 1.895706] systemd-modules-load[93]: Using 4 probe threads[ 2.043835] systemd[1]: Started Journal Service.517gitlab # 518gitlab # [ 1.899194] systemd-modules-load[93]: Inserted module 'virtio_balloon'519gitlab # [ 1.900442] systemd-modules-load[93]: Inserted module 'virtio_gpu'520gitlab # [ 1.903385] systemd-modules-load[93]: Inserted module 'dm_mod'521gitlab # [ 1.904441] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 1.908694] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.909747] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.910722] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.911610] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.912603] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 1.923197] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.932178] systemd-udevd[111]: Using default interface naming scheme 'v261'.529gitlab # [ 1.943696] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 1.966528] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 1.967389] systemd[1]: Reached target System Initialization.532gitlab # [ 1.968234] systemd[1]: Reached target Basic System.533gitlab # [ 2.201978] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12534gitlab # [ 2.206935] serio: i8042 KBD port at 0x60,0x64 irq 1535gitlab # [ 2.208415] SCSI subsystem initialized536gitlab # [ 2.210341] serio: i8042 AUX port at 0x60,0x64 irq 12537gitlab # [ 2.211833] uhci_hcd 0000:00:01.2: UHCI Host Controller538gitlab # [ 2.212982] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1539gitlab # [ 2.214097] uhci_hcd 0000:00:01.2: detected 2 ports540gitlab # [ 2.214994] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140541gitlab # [ 2.216073] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18542gitlab # [ 2.217271] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1543gitlab # [ 2.218325] usb usb1: Product: UHCI Host Controller544gitlab # [ 2.219094] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd545gitlab # [ 2.219901] usb usb1: SerialNumber: 0000:00:01.2546gitlab # [ 2.221232] hub 1-0:1.0: USB hub found547gitlab # [ 2.221874] hub 1-0:1.0: 2 ports detected548gitlab # [ 2.226702] virtio_blk virtio4: 4/0/0 default/read/poll queues549gitlab # [ 2.236629] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)550gitlab # [ 2.251932] virtio_blk virtio5: 4/0/0 default/read/poll queues551gitlab # [ 2.115156] systemd[1]: Starting Virtual Console Setup...552gitlab # [ 2.116255] (udev-worker)[127]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.553gitlab # [ 2.118311] (udev-worker)[127]: Network interface NamePolicy= disabled on kernel command line.554gitlab # [ 2.266571] scsi host0: ata_piix555gitlab # [ 2.270331] virtio_blk virtio5: [vdb] 11843576 512-byte logical blocks (6.06 GB/5.65 GiB)556gitlab # [ 2.270696] scsi host1: ata_piix557gitlab # [ 2.130910] (udev-worker)[126]: Network interface NamePolicy= disabled on ker[ 2.276974] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0558gitlab # nel command line[ 2.277009] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0559gitlab # .560gitlab # [ 2.280701] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0561gitlab # [ 2.142162] systemd-vconsole-setup[144]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 2.144614] systemd[1]: Finished Virtual Console Setup.563gitlab # [ 2.152482] systemd[1]: Found device /dev/disk/by-label/nixos.564gitlab # [ 2.153494] systemd[1]: Reached target Initrd Root Device.565gitlab # [ 2.154361] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...566gitlab # [ 2.155732] systemd[1]: Found device /dev/disk/by-label/nix-store.567gitlab # [ 2.176907] systemd-fsck[158]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.181060] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.439206] ata2: found unknown device (class 0)570gitlab # [ 2.442172] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100571gitlab # [ 2.446286] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5572gitlab # [ 2.448747] usb 1-1: new full-speed USB device number 2 using uhci_hcd573gitlab # [ 2.503277] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.530390] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.617708] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.620726] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.623422] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.625133] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.626627] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.657766] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.670341] usbcore: registered new interface driver usbhid582gitlab # [ 2.672062] usbhid: USB HID core driver583gitlab # [ 2.679590] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.683179] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.826755] systemd[1]: Mounting /sysroot...586gitlab # [ 3.139533] EXT4-fs (vda): mounted filesystem a8658b81-9b5d-4a74-b8ff-fce6fb834b6d r/w with ordered data mode. Quota mode: none.587gitlab # [ 2.999429] systemd[1]: Mounted /sysroot.588gitlab # [ 3.000429] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.002963] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.004543] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.006894] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.007900] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.025402] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.026454] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.040130] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.596gitlab # [ 3.046364] systemd[1]: Mounted /sysroot/nix/.rw-store.597gitlab # [ 3.047667] systemd[1]: Mounted /sysroot/run.598gitlab # [ 3.194359] 9p: Installing v9fs 9p2000 file system support599gitlab # [ 3.048705] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...600gitlab # [ 3.050844] systemd[1]: Reloading...601gitlab # [ 3.205397] erofs (device vdb): mounted with root inode @ nid 128.602gitlab # [ 3.115265] systemd[1]: Reloading finished in 65 ms.603gitlab # [ 3.138264] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...604gitlab # [ 3.141302] systemd[1]: Mounted /sysroot/nix/.ro-store.605gitlab # [ 3.143320] systemd[1]: Mounted /sysroot/tmp/shared.606gitlab # [ 3.145300] systemd[1]: Mounted /sysroot/tmp/xchg.607gitlab # [ 3.147378] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...608gitlab # [ 3.150150] systemd[1]: Starting rw-sysroot-nix-store.service...609gitlab # [ 3.152415] systemd[1]: initrd-parse-etc.service: Deactivated successfully.610gitlab # [ 3.154903] systemd[1]: Finished Mountpoints Configured in the Real Root.611gitlab # [ 3.157337] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.612gitlab # [ 3.166599] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.613gitlab # [ 3.169353] systemd[1]: Finished rw-sysroot-nix-store.service.614gitlab # [ 3.826911] systemd[1]: Mounting /sysroot/nix/store...615gitlab # [ 3.880097] systemd[1]: Mounted /sysroot/nix/store.616gitlab # [ 3.882347] systemd[1]: Reached target Initrd File Systems.617gitlab # [ 3.884764] systemd[1]: Starting Find NixOS closure...618gitlab # [ 3.886722] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...619gitlab # [ 3.913782] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.620gitlab # [ 3.917184] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.621gitlab # [ 3.935550] systemd[1]: Finished Find NixOS closure.622gitlab # [ 3.937555] systemd[1]: Reached target Initrd Default Target.623gitlab # [ 3.939789] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...624gitlab # [ 3.968138] systemd[1]: Stopped target Initrd Default Target.625gitlab # [ 3.970251] systemd[1]: Stopped target Basic System.626gitlab # [ 3.972093] systemd[1]: Stopped target Initrd Root Device.627gitlab # [ 3.973930] systemd[1]: Stopped target Path Units.628gitlab # [ 3.975560] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.629gitlab # [ 3.978208] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.630gitlab # [ 3.981313] systemd[1]: Stopped target Slice Units.631gitlab # [ 3.984308] systemd[1]: Stopped target Socket Units.632gitlab # [ 3.988542] systemd[1]: Stopped target System Initialization.633gitlab # [ 3.990774] systemd[1]: Stopped target Swaps.634gitlab # [ 3.992347] systemd[1]: Stopped target Timer Units.635gitlab # [ 3.993986] systemd[1]: dbus.socket: Deactivated successfully.636gitlab # [ 3.995968] systemd[1]: Closed D-Bus System Message Bus Socket.637gitlab # [ 3.998229] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.638gitlab # [ 4.001088] systemd[1]: Stopped Find NixOS closure.639gitlab # [ 4.002764] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio640gitlab # [ 4.006175] systemd[1]: Starting rw-sysroot-nix-store.service...641gitlab # [ 4.007814] systemd[1]: systemd-sysctl.service: Deactivated successfully.642gitlab # [ 4.009593] systemd[1]: Stopped Apply Kernel Variables.643gitlab # [ 4.011069] systemd[1]: systemd-modules-load.service: Deactivated successfully.644gitlab # [ 4.012970] systemd[1]: Stopped Load Kernel Modules.645gitlab # [ 4.014405] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.646gitlab # [ 4.016428] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.647gitlab # [ 4.018389] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.648gitlab # [ 4.020232] systemd[1]: Stopped Create System Files and Directories.649gitlab # [ 4.021782] systemd[1]: Stopped target Local File Systems.650gitlab # [ 4.023148] systemd[1]: Stopped target Preparation for Local File Systems.651gitlab # [ 4.024136] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.652gitlab # [ 4.025184] systemd[1]: Stopped Coldplug All udev Devices.653gitlab # [ 4.025968] systemd[1]: Stopping Rule-based Manager for Device Events and Files...654gitlab # [ 4.027056] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.655gitlab # [ 4.028174] systemd[1]: Stopped Virtual Console Setup.656gitlab # [ 4.028905] systemd[1]: initrd-cleanup.service: Deactivated successfully.657gitlab # [ 4.029856] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.658gitlab # [ 4.030791] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.659gitlab # [ 4.031844] systemd[1]: Finished rw-sysroot-nix-store.service.660gitlab # [ 4.032739] systemd[1]: systemd-udevd.service: Deactivated successfully.661gitlab # [ 4.033677] systemd[1]: Stopped Rule-based Manager for Device Events and Files.662gitlab # [ 4.034677] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.663gitlab # [ 4.035673] systemd[1]: Closed udev Control Socket.664gitlab # [ 4.036407] systemd[1]: Starting Cleanup udev Database...665gitlab # [ 4.037220] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.666gitlab # [ 4.038281] systemd[1]: Stopped Create Static Device Nodes in /dev.667gitlab # [ 4.039197] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.668gitlab # [ 4.040339] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.669gitlab # [ 4.041344] systemd[1]: kmod-static-nodes.service: Deactivated successfully.670gitlab # [ 4.042343] systemd[1]: Stopped Create List of Static Device Nodes.671gitlab # [ 4.074319] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.672gitlab # [ 4.075477] systemd[1]: Finished Cleanup udev Database.673gitlab # [ 4.076259] systemd[1]: Reached target Switch Root.674gitlab # [ 4.078054] systemd[1]: Starting NixOS Activation...675gitlab # [ 4.197839] initrd-nixos-activation-start[230]: booting system configuration /nix/store/1nzc3cy421hl4jsb2m04vqfhwc1br877-nixos-system-gitlab-test676gitlab # [ 4.237181] initrd-nixos-activation-start[230]: running activation script...677gitlab # [ 4.468718] initrd-nixos-activation-start[253]: setting up /etc...678gitlab # [ 4.581144] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.679gitlab # [ 4.584070] systemd[1]: Finished NixOS Activation.680gitlab # [ 4.585925] systemd[1]: Starting Switch Root...681gitlab # [ 4.612176] systemd[1]: Switching root.682gitlab # [ 4.813049] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).683gitlab # [ 4.910923] NET: Registered PF_VSOCK protocol family684gitlab # [ 5.277268] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)685gitlab # [ 5.288516] systemd[1]: Detected virtualization kvm.686gitlab # [ 5.290702] systemd[1]: Detected architecture x86-64.687gitlab # [ 5.292839] systemd[1]: Detected first boot.688gitlab # [ 5.295717] systemd[1]: Initializing machine ID from random generator.689gitlab # [ 5.439970] systemd[1]: bpf-restrict-fs: LSM BPF program attached690gitlab # [ 5.517448] systemd[1]: Applying preset policy.691gitlab # [ 5.648723] systemd[1]: Populated /etc with preset unit settings.692gitlab # [ 5.759494] systemd[1]: initrd-switch-root.service: Deactivated successfully.693gitlab # [ 5.760939] systemd[1]: Stopped initrd-switch-root.service.694gitlab # [ 5.763318] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.695gitlab # [ 5.765600] systemd[1]: Created slice Slice /system/getty.696gitlab # [ 5.767006] systemd[1]: Created slice GitLab DevOps Platform Slice.697gitlab # [ 5.768552] systemd[1]: Created slice User and Session Slice.698gitlab # [ 5.769472] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.699gitlab # [ 5.770701] systemd[1]: Started Forward Password Requests to Wall Directory Watch.700gitlab # [ 5.771848] systemd[1]: Expecting device /dev/hvc0...701gitlab # [ 5.772586] systemd[1]: Expecting device /dev/ttyS0...702gitlab # [ 5.773366] systemd[1]: Reached target Local Encrypted Volumes.703gitlab # [ 5.774227] systemd[1]: Stopped target initrd-fs.target.704gitlab # [ 5.775054] systemd[1]: Stopped target initrd-root-fs.target.705gitlab # [ 5.775909] systemd[1]: Stopped target initrd-switch-root.target.706gitlab # [ 5.776789] systemd[1]: Reached target Virtual Machines and Containers.707gitlab # [ 5.777734] systemd[1]: Reached target Path Units.708gitlab # [ 5.778427] systemd[1]: Reached target Remote File Systems.709gitlab # [ 5.779261] systemd[1]: Reached target Slice Units.710gitlab # [ 5.780018] systemd[1]: Reached target Swaps.711gitlab # [ 5.781444] systemd[1]: Listening on Query the User Interactively for a Password.712gitlab # [ 5.783397] systemd[1]: Listening on Process Core Dump Socket.713gitlab # [ 5.784850] systemd[1]: Listening on Credential Encryption/Decryption.714gitlab # [ 5.786411] systemd[1]: Listening on Factory Reset Management.715gitlab # [ 5.787356] systemd[1]: Listening on Hostname Service Socket.716gitlab # [ 5.789893] systemd[1]: Starting Journal Log Access Socket...717gitlab # [ 5.791473] systemd[1]: Listening on Journal Audit Socket.718gitlab # [ 5.793387] systemd[1]: Listening on Console Output Muting Service Socket.719gitlab # [ 5.794549] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.720gitlab # [ 5.795733] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os721gitlab # [ 5.797184] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki722gitlab # [ 5.799975] systemd[1]: Listening on Disk Repartitioning Service Socket.723gitlab # [ 5.801207] systemd[1]: Listening on udev Control Socket.724gitlab # [ 5.802174] systemd[1]: Listening on udev Varlink Socket.725gitlab # [ 5.804961] systemd[1]: Mounting Huge Pages File System...726gitlab # [ 5.807221] systemd[1]: Mounting POSIX Message Queue File System...727gitlab # [ 5.809281] systemd[1]: Mounting Kernel Debug File System...728gitlab # [ 5.812393] systemd[1]: Mounting Kernel Trace File System...729gitlab # [ 5.820537] systemd[1]: Starting Create List of Static Device Nodes...730gitlab # [ 5.823424] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio731gitlab # [ 5.836880] systemd[1]: Starting Load Kernel Module configfs...732gitlab # [ 5.839375] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm733gitlab # [ 5.843239] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore734gitlab # [ 5.847289] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse735gitlab # [ 5.880747] systemd[1]: Mounting FUSE Control File System...736gitlab # [ 5.882578] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67737gitlab # [ 5.890528] systemd[1]: Starting Journal Service...738gitlab # [ 5.893864] systemd[1]: Starting Load Kernel Modules...739gitlab # [ 5.898723] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...740gitlab # [ 5.901415] systemd[1]: Starting Remount Root and Kernel File Systems...741gitlab # [ 5.902439] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os742gitlab # [ 5.907711] systemd[1]: Starting Coldplug All udev Devices...743gitlab # [ 5.915411] systemd[1]: Listening on Journal Log Access Socket.744gitlab # [ 5.916244] systemd-journald[323]: Collecting audit messages is enabled.745gitlab # [ 5.917914] systemd[1]: Mounted Huge Pages File System.746gitlab # [ 5.921077] systemd[1]: Mounted POSIX Message Queue File System.747gitlab # [ 5.923911] systemd[1]: Mounted Kernel Debug File System.748gitlab # [ 5.926572] systemd[1]: Mounted Kernel Trace File System.749gitlab # [ 5.926810] loop: module loaded750gitlab # [ 5.928574] systemd[1]: Finished Create List of Static Device Nodes.751gitlab # [ 5.783482] systemd[1]: Queued start job for default target Multi-User System.752gitlab # [ 5.931399] systemd[1]: Started Journal Service.753gitlab # [ 5.785647] systemd[1]: Unnecessary job was removed for /dev/vdb.754gitlab # [ 5.787861] systemd[1]: systemd-journald.service: Deactivated successfully.755gitlab # [ 5.790200] systemd-modules-load[324]: Using 3 probe threads756gitlab # [ 5.938179] EXT4-fs (vda): re-mounted a8658b81-9b5d-4a74-b8ff-fce6fb834b6d.757gitlab # [ 5.791867] systemd-modules-load[324]: Inserted module 'tls'758gitlab # [ 5.794431] systemd-modules-load[324]: Inserted module 'loop'759gitlab # [ 5.795486] systemd[1]: modprobe@configfs.service: Deactivated successfully.760gitlab # [ 5.796621] systemd[1]: Finished Load Kernel Module configfs.761gitlab # [ 5.797608] systemd[1]: Mounted FUSE Control File System.762gitlab # [ 5.798553] systemd[1]: Finished Load Kernel Modules.763gitlab # [ 5.799511] systemd[1]: Finished Remount Root and Kernel File Systems.764gitlab # [ 5.802488] systemd[1]: Listening on Disk Image Download Service Socket.765gitlab # [ 5.803802] systemd[1]: Mounting Kernel Configuration File System...766gitlab # [ 5.806602] systemd[1]: Starting Firewall...767gitlab # [ 5.812127] systemd[1]: Starting Flush Journal to Persistent Storage...768gitlab # [ 5.813388] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore769gitlab # [ 5.817190] systemd[1]: Starting Load/Save OS Random Seed...770gitlab # [ 5.818440] systemd[1]: Starting Apply Kernel Variables...771gitlab # [ 5.821291] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...772gitlab # [ 5.822392] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os773gitlab # [ 5.825351] systemd-oomd[325]: No swap; memory pressure usage will be degraded774gitlab # [ 5.827933] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.775gitlab # [ 5.830978] systemd[1]: Mounted Kernel Configuration File System.776gitlab # [ 5.839252] systemd[1]: Finished Apply Kernel Variables.777gitlab # [ 5.988033] systemd-journald[323]: Received client request to flush runtime journal.778gitlab # [ 5.890346] systemd[1]: Finished Load/Save OS Random Seed.779gitlab # [ 5.891440] systemd[1]: Reached target First Boot Complete.780gitlab # [ 5.892463] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.781gitlab # [ 5.893548] systemd[1]: Starting Create Static Device Nodes in /dev...782gitlab # [ 5.894567] systemd[1]: Finished Create Static Device Nodes in /dev.783gitlab # [ 5.895586] systemd[1]: Reached target Preparation for Local File Systems.784gitlab # [ 5.896603] systemd[1]: Starting Rule-based Manager for Device Events and Files...785gitlab # [ 5.898688] systemd[1]: Finished Flush Journal to Persistent Storage.786gitlab # [ 5.908159] systemd-udevd[364]: Using default interface naming scheme 'v261'.787gitlab # [ 5.924617] systemd[1]: Finished Coldplug All udev Devices.788gitlab # [ 5.939186] systemd[1]: Started Rule-based Manager for Device Events and Files.789gitlab # [ 6.008600] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse790gitlab # [ 6.028267] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.791gitlab # [ 6.033641] (udev-worker)[434]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.792gitlab # [ 6.035908] (udev-worker)[434]: Network interface NamePolicy= disabled on kernel command line.793gitlab # [ 6.043984] systemd[1]: Condition check resulted in Virtio network device being skipped.794gitlab # [ 6.045919] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore795gitlab # [ 6.048139] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67796gitlab # [ 6.050799] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore797gitlab # [ 6.052494] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os798gitlab # [ 6.053791] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os799gitlab # [ 6.055436] (udev-worker)[426]: Network interface NamePolicy= disabled on kernel command line.800gitlab # [ 6.058184] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.801gitlab # [ 6.060056] systemd[1]: Finished Firewall.802gitlab # [ 6.256392] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3803gitlab # [ 6.263102] ACPI: button: Power Button [PWRF]804gitlab # [ 6.264596] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0805gitlab # [ 6.264828] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console806gitlab # [ 6.265023] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD807gitlab # [ 6.278901] Console: switching to colour dummy device 80x25808gitlab # [ 6.279759] [drm] Found bochs VGA, ID 0xb0c5.809gitlab # [ 6.280266] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.810gitlab # [ 6.283171] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic811gitlab # [ 6.284055] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0812gitlab # [ 6.297476] Console: switching to colour frame buffer device 160x50813gitlab # [ 6.299269] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device814gitlab # [ 6.308620] mousedev: PS/2 mouse device common for all mice815gitlab # [ 6.315803] rtc_cmos 00:05: RTC can wake from S4816gitlab # [ 6.317140] Floppy drive(s): fd0 is 2.88M AMI BIOS817gitlab # [ 6.325816] parport_pc 00:03: reported by Plug and Play ACPI818gitlab # [ 6.326552] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]819gitlab # [ 6.328474] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4820gitlab # [ 6.330251] FDC 0 is a S82078B821gitlab # [ 6.335299] rtc_cmos 00:05: registered as rtc0822gitlab # [ 6.336058] rtc_cmos 00:05: setting system clock to 2026-09-14T08:34:20 UTC (1789374860)823gitlab # [ 6.337143] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs824gitlab # [ 6.337310] systemd-journald[323]: Time jumped backwards, rotating.825gitlab # [ 6.352414] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6826gitlab # [ 6.356700] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5827gitlab # [ 6.239133] systemd[1]: Starting Virtual Console Setup...828gitlab # [ 6.260793] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.829gitlab # [ 6.262076] systemd[1]: Stopped Virtual Console Setup.830gitlab # [ 6.270229] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.291557] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.293154] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.300470] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.455708] ppdev: user-space parallel port driver835gitlab # [ 6.476392] kvm_amd: TSC scaling supported836gitlab # [ 6.477107] kvm_amd: Nested Virtualization enabled837gitlab # [ 6.477817] kvm_amd: Nested Paging enabled838gitlab # [ 6.478283] kvm_amd: LBR virtualization supported839gitlab # [ 6.479014] kvm_amd: Virtual VMLOAD VMSAVE supported840gitlab # [ 6.479743] kvm_amd: Virtual GIF supported841gitlab # [ 6.480283] kvm_amd: Virtual NMI enabled842gitlab # [ 6.515069] EDAC MC: Ver: 3.0.0843gitlab # [ 6.378148] systemd-vconsole-setup[500]: Configuration of first virtual console was skipped, ignoring remaining ones.844gitlab # [ 6.380541] systemd[1]: Finished Virtual Console Setup.845gitlab # [ 6.618309] systemd[1]: Mounting /run/wrappers...846gitlab # [ 6.641056] systemd[1]: Mounted /run/wrappers.847gitlab # [ 6.643147] systemd[1]: Reached target Local File Systems.848gitlab # [ 6.645314] systemd[1]: Listening on Boot Loader Control Service Socket.849gitlab # [ 6.647918] systemd[1]: Starting register-nix-paths.service...850gitlab # [ 6.650543] systemd[1]: Starting Create SUID/SGID Wrappers...851gitlab # [ 6.652707] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.852gitlab # [ 6.655676] systemd[1]: Starting Save Transient machine-id to Disk...853gitlab # [ 6.659378] systemd[1]: Starting Create System Files and Directories...854gitlab # [ 6.692227] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.855gitlab # [ 6.696580] systemd[1]: Finished Save Transient machine-id to Disk.856gitlab # [ 6.703040] systemd[1]: Finished Create System Files and Directories.857gitlab # [ 6.706633] systemd[1]: Starting Rebuild Journal Catalog...858gitlab # [ 6.708501] systemd[1]: Starting Record System Boot/Shutdown in UTMP...859gitlab # [ 6.729481] systemd[1]: Finished Record System Boot/Shutdown in UTMP.860gitlab # [ 6.745623] systemd[1]: Finished Rebuild Journal Catalog.861gitlab # [ 6.748994] systemd[1]: Starting Update is Completed...862gitlab # [ 6.762364] systemd[1]: Finished Update is Completed.863gitlab # [ 6.809141] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.864gitlab # [ 6.811551] systemd[1]: Finished Create SUID/SGID Wrappers.865gitlab # [ 7.066052] systemd[1]: Finished register-nix-paths.service.866gitlab # [ 7.069561] systemd[1]: Reached target System Initialization.867gitlab # [ 7.072038] systemd[1]: Started Discard unused filesystem blocks once a week.868gitlab # [ 7.074654] systemd[1]: Started logrotate.timer.869gitlab # [ 7.076261] systemd[1]: Started Daily Cleanup of Temporary Directories.870gitlab # [ 7.078293] systemd[1]: Reached target Timer Units.871gitlab # [ 7.080195] systemd[1]: Listening on D-Bus System Message Bus Socket.872gitlab # [ 7.082524] systemd[1]: Listening on Nix Daemon Socket.873gitlab # [ 7.095059] systemd[1]: Starting nixbot CI service socket...874gitlab # [ 7.097419] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.875gitlab # [ 7.100789] systemd[1]: Listening on nixbot CI service socket.876gitlab # [ 7.102938] systemd[1]: Reached target Socket Units.877gitlab # [ 7.105049] systemd[1]: Starting D-Bus System Message Bus...878gitlab # [ 7.182444] dbus-broker-launch[582]: Looking up NSS user entry for 'systemd-timesync'...879gitlab # [ 7.185727] dbus-broker-launch[582]: NSS returned no entry for 'systemd-timesync'880gitlab # [ 7.188531] dbus-broker-launch[582]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"881gitlab # [ 7.193663] systemd[1]: Started D-Bus System Message Bus.882gitlab # [ 7.214523] dbus-broker-launch[582]: Ready883gitlab # [ 7.218763] systemd[1]: Reached target Basic System.884gitlab # [ 7.221917] systemd[1]: Started backdoor.service.885gitlab # [ 7.225273] systemd[1]: Starting gitlab-config.service...886gitlab # [ 7.228128] systemd[1]: Starting Import lastlog data into lastlog2 database...887gitlab # [ 7.238632] systemd[1]: Starting Logrotate configuration check...888gitlab # [ 7.242532] systemd[1]: Starting Name Service Cache Daemon (nsncd)...889gitlab # [ 7.251170] systemd[1]: Starting Post-Boot Actions...890gitlab # [ 7.254824] systemd[1]: Started Reset console on configuration changes.891gitlab # [ 7.258942] systemd[1]: Starting resolvconf update...892gitlab # connecting to host...893gitlab # [ 7.267389] logrotate[587]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.894gitlab # [ 7.267566] logrotate[587]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf895gitlab # [ 7.268778] logrotate[587]: note: 'monthly' overrides previously specified 'weekly'896gitlab # [ 7.269266] logrotate[587]: Reading state from file: /var/lib/logrotate.status897gitlab # [ 7.269683] logrotate[587]: state file /var/lib/logrotate.status does not exist898gitlab # [ 7.271564] logrotate[587]: Allocating hash table for state file, size 64 entries899gitlab: Guest shell says: b'Spawning backdoor root shell...\n'900gitlab # [ 7.272196] logrotate[587]: Handling 4 logs901gitlab # [ 7.272801] logrotate[587]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed902gitlab: connected to guest root shell903gitlab # [ 7.275801] logrotate[587]: considering log /var/log/btmp904gitlab: (connecting took 7.95 seconds)905gitlab # [ 7.278645] logrotate[587]: Creating new state906gitlab: (finished: waiting for the VM to finish booting, in 7.95 seconds)907gitlab # [ 7.280383] logrotate[587]: Now: 2026-09-14 08:34908gitlab # [ 7.283706] logrotate[587]: Last rotated at 2026-09-14 08:00909gitlab # [ 7.283994] logrotate[587]: log does not need rotating (log has already been rotated)910gitlab # [ 7.284834] logrotate[587]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed911gitlab # [ 7.285731] logrotate[587]: considering log /var/log/wtmp912gitlab # [ 7.286377] logrotate[587]: Creating new state913gitlab # [ 7.286803] logrotate[587]: Now: 2026-09-14 08:34914gitlab # [ 7.287402] logrotate[587]: Last rotated at 2026-09-14 08:00915gitlab # [ 7.287826] logrotate[587]: log does not need rotating (log has already been rotated)916gitlab # [ 7.288470] logrotate[587]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed917gitlab # [ 7.288873] logrotate[587]: switching euid from 0 to 165 and egid from 0 to 165 (pid 587)918gitlab # [ 7.289487] logrotate[587]: considering log /var/gitlab/state/log/*.log919gitlab # [ 7.289913] logrotate[587]: log /var/gitlab/state/log/*.log does not exist -- skipping920gitlab # [ 7.290540] logrotate[587]: Creating new state921gitlab # [ 7.290979] logrotate[587]: switching euid from 165 to 0 and egid from 165 to 0 (pid 587)922gitlab # [ 7.291575] logrotate[587]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed923gitlab # [ 7.292059] logrotate[587]: switching euid from 0 to 60 and egid from 0 to 60 (pid 587)924gitlab # [ 7.292492] logrotate[587]: considering log /var/log/nginx/*.log925gitlab # [ 7.293396] logrotate[587]: log /var/log/nginx/*.log does not exist -- skipping926gitlab # [ 7.293828] logrotate[587]: Creating new state927gitlab # [ 7.294482] logrotate[587]: not running postrotate script, since no logs were rotated928gitlab # [ 7.294933] logrotate[587]: switching euid from 60 to 0 and egid from 60 to 0 (pid 587)929gitlab # [ 7.295736] systemd[1]: Finished Logrotate configuration check.930gitlab # [ 7.296590] systemd[1]: Finished Post-Boot Actions.931gitlab # [ 7.297655] systemd[1]: Finished Import lastlog data into lastlog2 database.932gitlab # [ 7.329937] nsncd[588]: Sep 14 08:34:21.640 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"933gitlab # [ 7.330295] systemd[1]: Started Name Service Cache Daemon (nsncd).934gitlab # [ 7.330815] systemd[1]: Reached target Host and Network Name Lookups.935gitlab # [ 7.331478] systemd[1]: Reached target User and Group Name Lookups.936gitlab # [ 7.333498] systemd[1]: Starting User Login Management...937gitlab # [ 7.363238] systemd[1]: Stopped target Host and Network Name Lookups.938gitlab # [ 7.364289] systemd[1]: Stopping Host and Network Name Lookups...939gitlab # [ 7.365310] systemd[1]: Stopped target User and Group Name Lookups.940gitlab # [ 7.366458] systemd[1]: Stopping User and Group Name Lookups...941gitlab # [ 7.367467] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...942gitlab # [ 7.368407] systemd[1]: nscd.service: Deactivated successfully.943gitlab # [ 7.369341] systemd[1]: Stopped Name Service Cache Daemon (nsncd).944gitlab # [ 7.370318] systemd[1]: nscd.service: Consumed 24ms CPU time over 125ms wall clock time, 7.1M memory peak, 5.5M read from disk.945gitlab # [ 7.372134] systemd[1]: Starting Name Service Cache Daemon (nsncd)...946gitlab # [ 7.374209] systemd-logind[633]: New seat seat0.947gitlab # [ 7.378980] systemd-logind[633]: Watching system buttons on /dev/input/event2 (Power Button)948gitlab # [ 7.380360] systemd-logind[633]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)949gitlab # [ 7.381767] systemd-logind[633]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)950gitlab # [ 7.383282] systemd[1]: Started User Login Management.951gitlab # [ 7.385174] systemd[1]: Starting linger-users.service...952gitlab # [ 7.391898] nsncd[678]: Sep 14 08:34:21.701 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"953gitlab # [ 7.392299] systemd[1]: Started Name Service Cache Daemon (nsncd).954gitlab # [ 7.397309] systemd[1]: Finished resolvconf update.955gitlab # [ 7.397686] systemd[1]: Reached target Preparation for Network.956gitlab # [ 7.398795] systemd[1]: Reached target Host and Network Name Lookups.957gitlab # [ 7.400131] systemd[1]: Reached target User and Group Name Lookups.958gitlab # [ 7.402327] systemd[1]: Starting DHCP Client...959gitlab # [ 7.403937] systemd[1]: Starting Address configuration of eth1...960gitlab # [ 7.407370] systemd[1]: Starting Extra networking commands....961gitlab # [ 7.409178] systemd[1]: linger-users.service: Deactivated successfully.962gitlab # [ 7.409587] systemd[1]: Finished linger-users.service.963gitlab # [ 7.432928] network-addresses-eth1-start[704]: adding address 192.168.1.1/24... done964gitlab # [ 7.435081] network-addresses-eth1-start[704]: adding address 2001:db8:1::1/64... done965gitlab # [ 7.440737] systemd[1]: Finished Address configuration of eth1.966gitlab # [ 7.471086] dhcpcd[715]: dhcpcd-10.3.2 starting967gitlab # [ 7.472795] dhcpcd[769]: dev: loaded udev968gitlab # [ 7.474273] systemd[1]: Finished Extra networking commands..969gitlab # [ 7.475400] systemd[1]: Reached target Network.970gitlab # [ 7.477090] systemd[1]: Starting gitlab-workhorse.service...971gitlab # [ 7.625906] 8021q: 802.1Q VLAN Support v1.8972gitlab # [ 7.480075] systemd[1]: Starting Nginx Web Server...973gitlab # [ 7.626422] 8021q: adding VLAN 0 to HW filter on device eth1974gitlab # [ 7.482422] systemd[1]: Starting PostgreSQL Server...975gitlab # [ 7.485787] systemd[1]: Starting Redis Server - redis-gitlab...976gitlab # [ 7.487168] systemd[1]: Starting Permit User Sessions...977gitlab # [ 7.495252] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.978gitlab # [ 7.506707] systemd[1]: Finished Permit User Sessions.979gitlab # [ 7.507592] systemd[1]: Started Getty on tty1.980gitlab # [ 7.510292] systemd[1]: Reached target Login Prompts.981gitlab # [ 7.721533] cfg80211: Loading compiled-in X.509 certificates for regulatory database982gitlab # [ 7.729920] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'983gitlab # [ 7.731996] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'984gitlab # [ 7.733909] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2985gitlab # [ 7.735313] cfg80211: failed to load regulatory.db986gitlab # [ 7.598743] nginx-pre-start[795]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok987gitlab # [ 7.600912] nginx-pre-start[795]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful988gitlab # [ 7.606135] redis-server[794]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.989gitlab # [ 7.608055] redis-server[794]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo990gitlab # [ 7.608406] redis-server[794]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=794, just started991gitlab # [ 7.608884] redis-server[794]: Configuration loaded992gitlab # [ 7.609623] redis[794]: monotonic clock: POSIX clock_gettime993gitlab # [ 7.612350] redis[794]: Running mode=standalone, port=0.994gitlab # [ 7.612679] systemd[1]: Started Nginx Web Server.995gitlab # [ 7.613220] redis[794]: Server initialized996gitlab # [ 7.613673] systemd[1]: Started Redis Server - redis-gitlab.997gitlab # [ 7.614252] redis[794]: Ready to accept connections unix998gitlab # [ 7.614740] redis[794]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.999gitlab # [ 7.776987] 8021q: adding VLAN 0 to HW filter on device eth01000gitlab # [ 7.632879] dhcpcd[769]: eth0: waiting for carrier1001gitlab # [ 7.633090] dhcpcd[769]: eth0: carrier acquired1002gitlab # [ 7.637424] dhcpcd[769]: DUID 00:01:00:01:32:3a:6e:0d:52:54:00:12:34:561003gitlab # [ 7.637796] dhcpcd[769]: eth0: IAID 00:12:34:561004gitlab # [ 7.638626] dhcpcd[769]: eth0: adding address fe80::5054:ff:fe12:34561005gitlab # [ 7.645278] postgresql-pre-start[799]: The files belonging to this database system will be owned by user "postgres".1006gitlab # [ 7.645647] postgresql-pre-start[799]: This user must also own the server process.1007gitlab # [ 7.649956] postgresql-pre-start[799]: The database cluster will be initialized with locale "en_US.UTF-8".1008gitlab # [ 7.650557] postgresql-pre-start[799]: The default database encoding has accordingly been set to "UTF8".1009gitlab # [ 7.651153] postgresql-pre-start[799]: The default text search configuration will be set to "english".1010gitlab # [ 7.651715] postgresql-pre-start[799]: Data page checksums are enabled.1011gitlab # [ 7.652397] postgresql-pre-start[799]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1012gitlab # [ 7.656736] postgresql-pre-start[799]: creating subdirectories ... ok1013gitlab # [ 7.657798] postgresql-pre-start[799]: selecting dynamic shared memory implementation ... posix1014gitlab # [ 7.692162] postgresql-pre-start[799]: selecting default "max_connections" ... 1001015gitlab # [ 7.727399] postgresql-pre-start[799]: selecting default "shared_buffers" ... 128MB1016gitlab # [ 8.022148] systemd[1]: Started gitlab-workhorse.service.1017gitlab # [ 8.114639] postgresql-pre-start[799]: selecting default time zone ... UTC1018gitlab # [ 8.116127] postgresql-pre-start[799]: creating configuration files ... ok1019gitlab # [ 8.246915] gitlab-workhorse[829]: time="2026-09-14T08:34:22Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41020gitlab # [ 8.247323] gitlab-workhorse[829]: time="2026-09-14T08:34:22Z" level=info msg="Using redis/go-redis"1021gitlab # [ 8.247964] gitlab-workhorse[829]: time="2026-09-14T08:34:22Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1022gitlab # [ 8.276949] postgresql-pre-start[799]: running bootstrap script ... ok1023gitlab # [ 8.700412] postgresql-pre-start[799]: performing post-bootstrap initialization ... ok1024gitlab # [ 8.976477] postgresql-pre-start[799]: syncing data to disk ... ok1025gitlab # [ 8.977308] postgresql-pre-start[799]: initdb: warning: enabling "trust" authentication for local connections1026gitlab # [ 8.978379] postgresql-pre-start[799]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1027gitlab # [ 8.979512] postgresql-pre-start[799]: Success. You can now start the database server using:1028gitlab # [ 8.981195] postgresql-pre-start[799]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1029gitlab # [ 9.089428] postgres[855]: [855] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1030gitlab # [ 9.093470] postgres[855]: [855] LOG: listening on IPv6 address "::1", port 54321031gitlab # [ 9.094218] postgres[855]: [855] LOG: listening on IPv4 address "127.0.0.1", port 54321032gitlab # [ 9.101755] postgres[855]: [855] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1033gitlab # [ 9.120655] postgres[864]: [864] LOG: database system was shut down at 2026-09-14 08:34:23 GMT1034gitlab # [ 9.129700] postgres[855]: [855] LOG: database system is ready to accept connections1035gitlab # [ 9.134614] systemd[1]: Started PostgreSQL Server.1036gitlab # [ 9.137638] systemd[1]: Starting PostgreSQL Setup Scripts...1037gitlab # [ 9.319271] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[872]: mkdir -p /var/gitlab/state/home/.ssh: OK1038gitlab # [ 9.320834] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[872]: chmod 700 /var/gitlab/state/home/.ssh: OK1039gitlab # [ 9.332128] postgresql-setup-start[880]: CREATE DATABASE1040gitlab # [ 9.353031] postgresql-setup-start[892]: CREATE ROLE1041gitlab # [ 9.362552] postgresql-setup-start[896]: ALTER DATABASE1042gitlab # [ 9.367182] dhcpcd[769]: eth0: soliciting a DHCP lease1043gitlab # [ 9.521528] NET: Registered PF_PACKET protocol family1044gitlab # [ 9.381104] dhcpcd[769]: eth0: offered 10.0.2.15 from 10.0.2.21045gitlab # [ 9.381988] systemd[1]: Finished gitlab-config.service.1046gitlab # [ 9.383943] systemd[1]: Started gitaly.service.1047gitlab # [ 9.386245] postgresql-setup-start[907]: CREATE ROLE1048gitlab # [ 9.386801] dhcpcd[769]: eth0: probing address 10.0.2.15/241049gitlab # [ 9.390137] systemd[1]: Finished PostgreSQL Setup Scripts.1050gitlab # [ 9.396528] systemd[1]: Reached target PostgreSQL.1051gitlab # [ 9.397959] systemd[1]: Starting gitlab-db-config.service...1052gitlab # [ 9.399859] systemd[1]: Starting gitlab-postgresql.service...1053gitlab # [ 9.407938] dhcpcd[769]: eth0: soliciting an IPv6 router1054gitlab # [ 9.409593] dhcpcd[769]: eth0: Router Advertisement from fe80::21055gitlab # [ 9.410075] dhcpcd[769]: eth0: adding address fec0::5054:ff:fe12:3456/641056gitlab # [ 9.410631] dhcpcd[769]: eth0: adding route to fec0::/641057gitlab # [ 9.411117] dhcpcd[769]: eth0: adding default route via fe80::21058gitlab # [ 9.484602] gitlab-postgresql-start[927]: CREATE DATABASE1059gitlab # [ 9.530928] gitlab-postgresql-start[932]: CREATE EXTENSION1060gitlab # [ 9.613755] gitlab-postgresql-start[934]: CREATE EXTENSION1061gitlab # [ 9.617823] systemd[1]: Finished gitlab-postgresql.service.1062gitlab # [ 9.852994] gitaly[911]: time="2026-09-14T08:34:24.163Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9111063gitlab # [ 9.853260] gitaly[911]: time="2026-09-14T08:34:24.163Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9111064gitlab # [ 9.853926] gitaly[911]: time="2026-09-14T08:34:24.163Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9111065gitlab # [ 9.855104] gitaly[911]: time="2026-09-14T08:34:24.163Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9111066gitlab # [ 9.855744] gitaly[911]: time="2026-09-14T08:34:24.163Z" level=info msg="Starting Gitaly" pid=911 version=1067gitlab # [ 10.023779] gitaly[911]: time="2026-09-14T08:34:24.334Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=170 pid=9111068gitlab # [ 10.025926] gitaly[911]: time="2026-09-14T08:34:24.334Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9111069gitlab # [ 10.027682] gitaly[911]: time="2026-09-14T08:34:24.334Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9111070gitlab # [ 10.029528] gitaly[911]: time="2026-09-14T08:34:24.334Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-911/git-exec-2982832838.d/git pid=9111071gitlab # [ 10.031861] gitaly[911]: time="2026-09-14T08:34:24.338Z" level=info msg="finished detecting git version" duration_ms=3 pid=9111072gitlab # [ 10.033690] gitaly[911]: time="2026-09-14T08:34:24.338Z" level=info msg="using Git version" pid=911 version=2.53.g1073gitlab # [ 10.035283] gitaly[911]: time="2026-09-14T08:34:24.338Z" level=info msg="clearing disk cache object folder" pid=911 storage=default1074gitlab # [ 10.037122] gitaly[911]: time="2026-09-14T08:34:24.339Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache95633493 pid=911 storage=default1075gitlab # [ 10.039927] gitaly[911]: time="2026-09-14T08:34:24.339Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache95633493 pid=911 storage=default1076gitlab # [ 10.043141] gitaly[911]: time="2026-09-14T08:34:24.339Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9111077gitlab # [ 10.046079] gitaly[911]: time="2026-09-14T08:34:24.339Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9111078gitlab # [ 10.048946] gitaly[911]: time="2026-09-14T08:34:24.339Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache95633493 clear_duration_ms=0 pid=911 storage=default1079gitlab # [ 10.064028] gitaly[911]: time="2026-09-14T08:34:24.374Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9111080gitlab # [ 10.066450] gitaly[911]: time="2026-09-14T08:34:24.374Z" level=info msg="finished tempdir cleaner walk" pid=911 storage=default time_ms=01081gitlab # [ 10.066555] gitaly[911]: time="2026-09-14T08:34:24.374Z" level=info msg="counting repositories" pid=9111082gitlab # [ 10.067165] gitaly[911]: time="2026-09-14T08:34:24.374Z" level=info msg="starting to count repositories" pid=911 storage_path=/var/gitlab/state/repositories1083gitlab # [ 10.067559] gitaly[911]: time="2026-09-14T08:34:24.374Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=911 storage_path=/var/gitlab/state/repositories1084gitlab # [ 10.068068] gitaly[911]: time="2026-09-14T08:34:24.374Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9111085gitlab # [ 10.068510] gitaly[911]: time="2026-09-14T08:34:24.374Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=911 schema=unix1086gitlab # [ 10.068955] gitaly[911]: time="2026-09-14T08:34:24.375Z" level=info msg="listening at address" address=/run/gitaly/gitaly-911/sock.d/intern pid=911 schema=unix1087gitlab # [ 10.069607] gitaly[911]: time="2026-09-14T08:34:24.376Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9111088gitlab # [ 10.070165] gitaly[911]: time="2026-09-14T08:34:24.376Z" level=info msg="Started Gitaly" duration_ms=213 pid=9111089gitlab # [ 10.070600] gitaly[911]: time="2026-09-14T08:34:24.377Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9111090gitlab # [ 10.071120] gitaly[911]: time="2026-09-14T08:34:24.377Z" level=info msg="maintenance: daily scheduled" pid=911 scheduled="2026-09-14 12:00:00 +0000 UTC"1091gitlab # [ 10.849790] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1092gitlab # [ 10.850582] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1093gitlab # [ 10.887083] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1094gitlab # [ 12.021851] gitaly[911]: time="2026-09-14T08:34:26.331Z" level=info msg="License database preloaded" duration_ms=2146 pid=9111095gitlab # [ 13.876798] dhcpcd[769]: eth0: leased 10.0.2.15 for 86400 seconds1096gitlab # [ 13.877038] dhcpcd[769]: eth0: adding route to 10.0.2.0/241097gitlab # [ 13.877847] dhcpcd[769]: eth0: adding default route via 10.0.2.21098gitlab # [ 13.967905] systemd[1]: Started DHCP Client.1099gitlab # [ 13.969996] systemd[1]: Reached target Network is Online.1100gitlab # [ 39.996384] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[924]: W, [2026-09-14T08:34:54.306025 #924] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1101gitlab # [ 41.919490] postgres[1304]: [1304] ERROR: relation "feature_gates" does not exist at character 5231102gitlab # [ 41.920147] postgres[1304]: [1304] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1103gitlab # [ 41.920874] postgres[1304]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1104gitlab # [ 41.922081] postgres[1304]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1105gitlab # [ 41.923066] postgres[1304]: attidentity AS identity,1106gitlab # [ 41.923887] postgres[1304]: attgenerated as attgenerated1107gitlab # [ 41.924471] postgres[1304]: FROM pg_attribute a1108gitlab # [ 41.925517] postgres[1304]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1109gitlab # [ 41.926283] postgres[1304]: LEFT JOIN pg_type t ON a.atttypid = t.oid1110gitlab # [ 41.927284] postgres[1304]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1111gitlab # [ 41.928110] postgres[1304]: WHERE a.attrelid = '"feature_gates"'::regclass1112gitlab # [ 41.928976] postgres[1304]: AND a.attnum > 0 AND NOT a.attisdropped1113gitlab # [ 41.929852] postgres[1304]: ORDER BY a.attnum1114gitlab # [ 41.930954] postgres[1304]:1115gitlab # [ 45.241394] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1346]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1116gitlab # [ 45.241847] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1346]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1117gitlab # [ 48.288437] gitlab-workhorse[829]: time="2026-09-14T08:35:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 58.289931] gitlab-workhorse[829]: time="2026-09-14T08:35:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 59.931412] postgres[1412]: [1412] ERROR: relation "table_without_models" does not exist1120gitlab # [ 59.932259] postgres[1412]: [1412] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1121gitlab # [ 68.299507] gitlab-workhorse[829]: time="2026-09-14T08:35:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 71.709509] systemd[1]: Finished gitlab-db-config.service.1123gitlab # [ 71.714715] systemd[1]: Started gitlab-sidekiq.service.1124gitlab # [ 71.718235] systemd[1]: Starting gitlab.service...1125gitlab # [ 72.082144] bundle[1579]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1126gitlab # [ 72.082592] bundle[1579]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1127gitlab # [ 72.084094] bundle[1579]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1128gitlab # [ 74.715220] sidekiq-cluster[1578]: {"severity":"INFO","time":"2026-09-14T08:35:29.008Z","message":"Starting cluster with 1 processes"}1129gitlab # [ 74.886198] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.177Z","pid":1579,"message":"* Enabling systemd notification integration"}1130gitlab # [ 74.886557] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.195Z","pid":1579,"message":"Puma starting in cluster mode..."}1131gitlab # [ 74.888161] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.196Z","pid":1579,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1132gitlab # [ 74.889415] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.196Z","pid":1579,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1133gitlab # [ 74.890409] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.196Z","pid":1579,"message":"* Min threads: 0"}1134gitlab # [ 74.891866] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.196Z","pid":1579,"message":"* Max threads: 4"}1135gitlab # [ 74.893084] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.196Z","pid":1579,"message":"* Environment: production"}1136gitlab # [ 74.894187] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.196Z","pid":1579,"message":"* Master PID: 1579"}1137gitlab # [ 74.895323] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.196Z","pid":1579,"message":"* Workers: 2"}1138gitlab # [ 74.896470] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.196Z","pid":1579,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1139gitlab # [ 74.897603] bundle[1579]: {"timestamp":"2026-09-14T08:35:29.196Z","pid":1579,"message":"* Preloading application"}1140gitlab # [ 78.309824] gitlab-workhorse[829]: time="2026-09-14T08:35:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 88.314202] gitlab-workhorse[829]: time="2026-09-14T08:35:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 97.117675] bundle[1579]: W, [2026-09-14T08:35:51.427255 #1579] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1143gitlab # [ 98.314857] gitlab-workhorse[829]: time="2026-09-14T08:35:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 99.303291] sidekiq-cluster[1609]: 2026-09-14T08:35:53.612Z pid=1609 tid=wkh INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1609, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432578560}1145gitlab # [ 99.470952] sidekiq-cluster[1609]: W, [2026-09-14T08:35:53.781056 #1609] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 99.508628] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:53.818Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1147gitlab # [ 101.323773] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.633Z","message":"GitLab reliable fetch activated!"}1148gitlab # [ 101.324415] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.633Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1149gitlab # [ 101.345879] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.656Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1150gitlab # [ 101.348059] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.658Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1151gitlab # [ 101.350408] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.660Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1152gitlab # [ 101.352717] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.663Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1153gitlab # [ 101.355125] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.665Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1154gitlab # [ 101.357397] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.667Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1155gitlab # [ 101.359558] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.670Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1156gitlab # [ 101.361593] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.672Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1157gitlab # [ 101.363587] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.674Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1158gitlab # [ 101.365594] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.676Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1159gitlab # [ 101.367565] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.678Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1160gitlab # [ 101.370091] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.680Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1161gitlab # [ 101.372214] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.682Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1162gitlab # [ 101.374080] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.684Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1163gitlab # [ 101.376287] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.686Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1164gitlab # [ 101.378214] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.688Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1165gitlab # [ 101.381086] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.691Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1166gitlab # [ 101.383694] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.694Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1167gitlab # [ 101.386200] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.696Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1168gitlab # [ 101.388738] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.699Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1169gitlab # [ 101.391268] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.701Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1170gitlab # [ 101.393589] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.704Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1171gitlab # [ 101.395687] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.706Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1172gitlab # [ 101.397796] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.708Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1173gitlab # [ 101.399867] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.710Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1174gitlab # [ 101.402831] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.713Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1175gitlab # [ 101.405450] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.715Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1176gitlab # [ 101.408044] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.718Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1177gitlab # [ 101.410522] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.720Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1178gitlab # [ 101.413056] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.723Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1179gitlab # [ 101.415112] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.725Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1180gitlab # [ 101.417608] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.728Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1181gitlab # [ 101.419992] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.730Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1182gitlab # [ 101.422397] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.732Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1183gitlab # [ 101.424407] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.734Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1184gitlab # [ 101.426744] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.737Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1185gitlab # [ 101.428920] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.739Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1186gitlab # [ 101.431286] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.741Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1187gitlab # [ 101.433362] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.743Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1188gitlab # [ 101.435487] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.745Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1189gitlab # [ 101.437622] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.748Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1190gitlab # [ 101.439603] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.750Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1191gitlab # [ 101.441871] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.752Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1192gitlab # [ 101.444059] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.754Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1193gitlab # [ 101.446718] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.757Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1194gitlab # [ 101.449118] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.759Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1195gitlab # [ 101.451244] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.761Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1196gitlab # [ 101.453403] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.763Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1197gitlab # [ 101.455868] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.766Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1198gitlab # [ 101.457901] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.768Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1199gitlab # [ 101.460362] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.770Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1200gitlab # [ 101.462927] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.773Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1201gitlab # [ 101.473964] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.784Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1202gitlab # [ 101.479746] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.790Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1203gitlab # [ 101.484097] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.794Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1204gitlab # [ 101.488371] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.798Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1205gitlab # [ 101.492945] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.803Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1206gitlab # [ 101.497701] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.808Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1207gitlab # [ 101.502183] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.812Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1208gitlab # [ 101.506389] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.816Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1209gitlab # [ 101.510255] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.820Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1210gitlab # [ 101.513669] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.824Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1211gitlab # [ 101.517905] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.828Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1212gitlab # [ 101.522346] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.832Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1213gitlab # [ 101.526328] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.836Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1214gitlab # [ 101.530583] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.841Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1215gitlab # [ 101.535193] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.845Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1216gitlab # [ 101.539423] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.849Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1217gitlab # [ 101.543814] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.854Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1218gitlab # [ 101.547854] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.858Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1219gitlab # [ 101.552356] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.862Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1220gitlab # [ 101.556566] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.867Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1221gitlab # [ 101.560797] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.871Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1222gitlab # [ 101.564982] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.875Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1223gitlab # [ 101.569329] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.879Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1224gitlab # [ 101.614732] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.925Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1225gitlab # [ 101.618859] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.929Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1226gitlab # [ 101.624889] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.935Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1227gitlab # [ 101.627882] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.938Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1228gitlab # [ 101.633672] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.944Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1229gitlab # [ 101.640600] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.950Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1230gitlab # [ 101.646954] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.957Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1231gitlab # [ 101.653347] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.963Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1232gitlab # [ 101.659322] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.969Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1233gitlab # [ 101.665512] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.975Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1234gitlab # [ 101.671368] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.981Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1235gitlab # [ 101.677375] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.987Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1236gitlab # [ 101.683302] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.993Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1237gitlab # [ 101.688537] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:55.998Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1238gitlab # [ 101.694350] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.004Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1239gitlab # [ 101.699347] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.009Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1240gitlab # [ 101.704529] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.014Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1241gitlab # [ 101.709561] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.019Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1242gitlab # [ 101.714725] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.025Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1243gitlab # [ 101.721311] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.031Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1244gitlab # [ 101.728255] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.038Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1245gitlab # [ 101.736963] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.047Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1246gitlab # [ 101.741678] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.052Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1247gitlab # [ 101.760546] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.070Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1248gitlab # [ 101.766170] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.076Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1249gitlab # [ 101.772435] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.082Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1250gitlab # [ 101.778297] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.088Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1251gitlab # [ 101.783087] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.092Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1252gitlab # [ 101.785644] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.096Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1253gitlab # [ 101.788045] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.098Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1254gitlab # [ 101.790308] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.100Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1255gitlab # [ 101.792522] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.103Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1256gitlab # [ 101.797135] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.107Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1257gitlab # [ 101.802394] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:35:56.112Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1258gitlab # [ 108.325577] gitlab-workhorse[829]: time="2026-09-14T08:36:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1259gitlab # [ 118.335580] gitlab-workhorse[829]: time="2026-09-14T08:36:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 125.720604] postgres[2038]: [2038] ERROR: relation "table_without_models" does not exist1261gitlab # [ 125.720970] postgres[2038]: [2038] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1262gitlab # [ 127.827407] postgres[2058]: [2058] ERROR: relation "table_without_models" does not exist1263gitlab # [ 127.828264] postgres[2058]: [2058] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1264gitlab # [ 128.208510] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:22.518Z","message":"Booted Rails 7.2.3.1 application in production environment"}1265gitlab # [ 128.212648] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:22.522Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1266gitlab # [ 128.212764] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:22.522Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1267gitlab # [ 128.213472] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:22.522Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1268gitlab # [ 128.219358] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:22.529Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1269gitlab # [ 128.337149] gitlab-workhorse[829]: time="2026-09-14T08:36:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1270gitlab # [ 129.509945] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:23.820Z","message":"Cleaning working queues"}1271gitlab # [ 129.512391] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:23.822Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ae5a93995ffcdf187fc197ee","created_at":"2026-09-14T08:35:25.673Z","trace_propagation_headers":{"sentry-trace":"eecc98e8c7004b75affae1879c741d9c-c28d0cff1a374018","baggage":"sentry-trace_id=eecc98e8c7004b75affae1879c741d9c,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ba38ada6d75ecbf4fa884a76ea4f2de1","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-14T08:35:25.681Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ae5a93995ffcdf187fc197ee: start","job_status":"start","queue_duration_s":58.140942,"scheduling_latency_s":58.141025}1272gitlab # [ 129.693644] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:24.003Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ae5a93995ffcdf187fc197ee","created_at":"2026-09-14T08:35:25.673Z","trace_propagation_headers":{"sentry-trace":"eecc98e8c7004b75affae1879c741d9c-c28d0cff1a374018","baggage":"sentry-trace_id=eecc98e8c7004b75affae1879c741d9c,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ba38ada6d75ecbf4fa884a76ea4f2de1","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-14T08:35:25.681Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ae5a93995ffcdf187fc197ee: done: 0.181232 sec","job_status":"done","queue_duration_s":58.140942,"scheduling_latency_s":58.141025,"redis_calls":31,"redis_duration_s":0.006044,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.003357,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001665,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10223534,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.181232,"completed_at":"2026-09-14T08:36:24.003Z","load_balancing_strategy":"primary","db_duration_s":0.065686,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1273gitlab # [ 130.616506] bundle[1579]: {"timestamp":"2026-09-14T08:36:24.926Z","pid":1579,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1274gitlab # [ 130.620917] bundle[1579]: {"timestamp":"2026-09-14T08:36:24.926Z","pid":1579,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1275gitlab # [ 130.624766] bundle[1579]: {"timestamp":"2026-09-14T08:36:24.926Z","pid":1579,"message":"! #\u003cThread:0x00007e38e43c28f0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1276gitlab # [ 130.636131] bundle[1579]: {"timestamp":"2026-09-14T08:36:24.926Z","pid":1579,"message":"! #\u003cThread:0x00007e38e46776b8 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1277gitlab # [ 130.647411] bundle[1579]: {"timestamp":"2026-09-14T08:36:24.926Z","pid":1579,"message":"Use Ctrl-C to stop"}1278gitlab # [ 130.650401] bundle[1579]: {"timestamp":"2026-09-14T08:36:24.926Z","pid":1579,"message":"Sending status to systemd every 1.0 sec"}1279gitlab # [ 130.943517] bundle[1579]: {"timestamp":"2026-09-14T08:36:25.253Z","pid":1579,"message":"- Worker 1 (PID: 2163) booted in 0.28s, phase: 0"}1280gitlab # [ 130.947576] bundle[1579]: {"timestamp":"2026-09-14T08:36:25.255Z","pid":1579,"message":"- Worker 0 (PID: 2159) booted in 0.3s, phase: 0"}1281gitlab # [ 130.952329] systemd[1]: Started gitlab.service.1282gitlab # [ 130.954184] systemd[1]: Reached target Common target for all GitLab services..1283gitlab # [ 130.956642] systemd[1]: Starting setup-gitlab.service...1284gitlab # [ 130.979124] setup-gitlab-start[2187]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1285gitlab # [ 133.235119] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:36:27 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 22331286gitlab # [ 133.240199] setup-gitlab-start[2187]: + TOKEN=nixbot-test-token-of-20-chars1287gitlab # [ 133.242765] setup-gitlab-start[2187]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1288gitlab # [ 133.254736] runuser[2209]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1289gitlab # [ 133.638413] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1290gitlab # [ 133.643378] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1291gitlab # [ 133.648205] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1292gitlab # [ 134.207164] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 134.212158] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 134.216871] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 140.076131] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"03e15cfac417207f14726cc0","created_at":"2026-09-14T08:36:34.353Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2a50ffefb20c0c7d16255db59028bd8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.382Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-03e15cfac417207f14726cc0: start","job_status":"start","queue_duration_s":0.002515,"scheduling_latency_s":0.002551}1296gitlab # [ 140.174453] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.484Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"03e15cfac417207f14726cc0","created_at":"2026-09-14T08:36:34.353Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2a50ffefb20c0c7d16255db59028bd8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.382Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-03e15cfac417207f14726cc0: done: 0.098832 sec","job_status":"done","queue_duration_s":0.002515,"scheduling_latency_s":0.002551,"redis_calls":10,"redis_duration_s":0.037589,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003542,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.031403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002644,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000801778,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.098832,"completed_at":"2026-09-14T08:36:34.484Z","load_balancing_strategy":"primary","db_duration_s":0.018912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 140.237064] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1bf890fce46938c354cee184","created_at":"2026-09-14T08:36:34.391Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ef6edbb6d852f019329af1f9209c4dc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.406Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1bf890fce46938c354cee184: start","job_status":"start","queue_duration_s":0.080525,"scheduling_latency_s":0.080564}1298gitlab # [ 140.249856] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1bf890fce46938c354cee184","created_at":"2026-09-14T08:36:34.391Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ef6edbb6d852f019329af1f9209c4dc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.406Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1bf890fce46938c354cee184: done: 0.051353 sec","job_status":"done","queue_duration_s":0.080525,"scheduling_latency_s":0.080564,"redis_calls":12,"redis_duration_s":0.012199999999999999,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003307,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001411,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001797714,"duration_s":0.051353,"completed_at":"2026-09-14T08:36:34.538Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007619,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 140.270880] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"19b9a8ba89bf6428f1f50de4","created_at":"2026-09-14T08:36:34.435Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e813eebf934e58d462a77dbf7c6c1b52","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T08:36:34.450Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-19b9a8ba89bf6428f1f50de4: start","job_status":"start","queue_duration_s":0.092895,"scheduling_latency_s":0.092926}1300gitlab # [ 140.271759] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.580Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1301gitlab # [ 140.274941] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"19b9a8ba89bf6428f1f50de4","created_at":"2026-09-14T08:36:34.435Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e813eebf934e58d462a77dbf7c6c1b52","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T08:36:34.450Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-19b9a8ba89bf6428f1f50de4: done: 0.041343 sec","job_status":"done","queue_duration_s":0.092895,"scheduling_latency_s":0.092926,"redis_calls":10,"redis_duration_s":0.021253,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002465,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.015559,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206171,"duration_s":0.041343,"completed_at":"2026-09-14T08:36:34.585Z","load_balancing_strategy":"primary","db_duration_s":0.001911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 140.302141] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"db993d7d2ef09138190cc669","created_at":"2026-09-14T08:36:34.467Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58e7ad90691e8d649ff8d150c97c1b90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.507Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-db993d7d2ef09138190cc669: start","job_status":"start","queue_duration_s":0.078372,"scheduling_latency_s":0.078385}1303gitlab # [ 140.314282] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"db993d7d2ef09138190cc669","created_at":"2026-09-14T08:36:34.467Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58e7ad90691e8d649ff8d150c97c1b90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.507Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-db993d7d2ef09138190cc669: done: 0.021151 sec","job_status":"done","queue_duration_s":0.078372,"scheduling_latency_s":0.078385,"redis_calls":19,"redis_duration_s":0.00232,"redis_read_bytes":21,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000201,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216508,"duration_s":0.021151,"completed_at":"2026-09-14T08:36:34.607Z","load_balancing_strategy":"primary","db_duration_s":0.001505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 140.353902] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.608Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"0f05a4c906e6037db8d4efe0","created_at":"2026-09-14T08:36:34.526Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af48c8c9a2d42783a0d655524cfa2bd1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.543Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-0f05a4c906e6037db8d4efe0: start","job_status":"start","queue_duration_s":0.065092,"scheduling_latency_s":0.065105}1305gitlab # [ 140.366075] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.619Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"0f05a4c906e6037db8d4efe0","created_at":"2026-09-14T08:36:34.526Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af48c8c9a2d42783a0d655524cfa2bd1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.543Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-0f05a4c906e6037db8d4efe0: done: 0.011512 sec","job_status":"done","queue_duration_s":0.065092,"scheduling_latency_s":0.065105,"redis_calls":12,"redis_duration_s":0.00147,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192203,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.011512,"completed_at":"2026-09-14T08:36:34.619Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 140.406194] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.620Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"22c63c6ef129527961548c31","created_at":"2026-09-14T08:36:34.595Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0ac4d29bc88f41e0","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"58e7ad90691e8d649ff8d150c97c1b90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.603Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-22c63c6ef129527961548c31: start","job_status":"start","queue_duration_s":0.0176,"scheduling_latency_s":0.017614}1307gitlab # [ 140.445792] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.634Z","message":"No existing merge request to be cleaned up."}1308gitlab # [ 140.446582] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.644Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"22c63c6ef129527961548c31","created_at":"2026-09-14T08:36:34.595Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0ac4d29bc88f41e0","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"58e7ad90691e8d649ff8d150c97c1b90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.603Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-22c63c6ef129527961548c31: done: 0.023907 sec","job_status":"done","queue_duration_s":0.0176,"scheduling_latency_s":0.017614,"redis_calls":13,"redis_duration_s":0.0017980000000000001,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207289,"duration_s":0.023907,"completed_at":"2026-09-14T08:36:34.644Z","load_balancing_strategy":"primary","db_duration_s":0.00403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 140.488722] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.645Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4bbe7c9093a1407150771841","created_at":"2026-09-14T08:36:34.595Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0ac4d29bc88f41e0","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"58e7ad90691e8d649ff8d150c97c1b90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.603Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4bbe7c9093a1407150771841: start","job_status":"start","queue_duration_s":0.04238,"scheduling_latency_s":0.042393}1310gitlab # [ 140.489637] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.652Z","message":"No existing merge request to be cleaned up."}1311gitlab # [ 140.490213] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.656Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4bbe7c9093a1407150771841","created_at":"2026-09-14T08:36:34.595Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0ac4d29bc88f41e0","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"58e7ad90691e8d649ff8d150c97c1b90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.603Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4bbe7c9093a1407150771841: done: 0.011093 sec","job_status":"done","queue_duration_s":0.04238,"scheduling_latency_s":0.042393,"redis_calls":10,"redis_duration_s":0.001373,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00073,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011093,"completed_at":"2026-09-14T08:36:34.656Z","load_balancing_strategy":"primary","db_duration_s":0.000908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 140.501712] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.657Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8396368a612105c133b242f0","created_at":"2026-09-14T08:36:34.595Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0ac4d29bc88f41e0","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"58e7ad90691e8d649ff8d150c97c1b90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.603Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8396368a612105c133b242f0: start","job_status":"start","queue_duration_s":0.054443,"scheduling_latency_s":0.054458}1313gitlab # [ 140.512874] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.663Z","message":"No existing merge request to be cleaned up."}1314gitlab # [ 140.551718] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.668Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8396368a612105c133b242f0","created_at":"2026-09-14T08:36:34.595Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0ac4d29bc88f41e0","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"58e7ad90691e8d649ff8d150c97c1b90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.603Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8396368a612105c133b242f0: done: 0.010663 sec","job_status":"done","queue_duration_s":0.054443,"scheduling_latency_s":0.054458,"redis_calls":10,"redis_duration_s":0.0012439999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010663,"completed_at":"2026-09-14T08:36:34.668Z","load_balancing_strategy":"primary","db_duration_s":0.00091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 140.552884] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.668Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1cf747a8973d6d9221d912c1","created_at":"2026-09-14T08:36:34.595Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0ac4d29bc88f41e0","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"58e7ad90691e8d649ff8d150c97c1b90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.603Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1cf747a8973d6d9221d912c1: start","job_status":"start","queue_duration_s":0.065932,"scheduling_latency_s":0.065945}1316gitlab # [ 140.559841] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.675Z","message":"No existing merge request to be cleaned up."}1317gitlab # [ 140.561531] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.681Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1cf747a8973d6d9221d912c1","created_at":"2026-09-14T08:36:34.595Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0ac4d29bc88f41e0","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"58e7ad90691e8d649ff8d150c97c1b90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.603Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1cf747a8973d6d9221d912c1: done: 0.012087 sec","job_status":"done","queue_duration_s":0.065932,"scheduling_latency_s":0.065945,"redis_calls":10,"redis_duration_s":0.001262,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000728,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012087,"completed_at":"2026-09-14T08:36:34.681Z","load_balancing_strategy":"primary","db_duration_s":0.002406,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 140.609800] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e0fa82e2d48e667e5de5a0a2","created_at":"2026-09-14T08:36:34.570Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c0fed329b7774f783317553fdc8e010","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.683Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e0fa82e2d48e667e5de5a0a2: start","job_status":"start","queue_duration_s":0.001427,"scheduling_latency_s":0.00144}1319gitlab # [ 140.610718] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e0fa82e2d48e667e5de5a0a2","created_at":"2026-09-14T08:36:34.570Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c0fed329b7774f783317553fdc8e010","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.683Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e0fa82e2d48e667e5de5a0a2: done: 0.027654 sec","job_status":"done","queue_duration_s":0.001427,"scheduling_latency_s":0.00144,"redis_calls":10,"redis_duration_s":0.009212,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00543,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003539,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002341359,"duration_s":0.027654,"completed_at":"2026-09-14T08:36:34.712Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 140.646075] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.714Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b477038796394e3ab59d8220","created_at":"2026-09-14T08:36:34.693Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5d978962859902baed14ade8e83ac1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.700Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b477038796394e3ab59d8220: start","job_status":"start","queue_duration_s":0.014249,"scheduling_latency_s":0.014271}1321gitlab # [ 140.693971] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.791Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b477038796394e3ab59d8220","created_at":"2026-09-14T08:36:34.693Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5d978962859902baed14ade8e83ac1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.700Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b477038796394e3ab59d8220: done: 0.07642 sec","job_status":"done","queue_duration_s":0.014249,"scheduling_latency_s":0.014271,"redis_calls":12,"redis_duration_s":0.010192999999999999,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006337,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002558,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000666565,"exclusive_lock_hold_duration_s":0.026775471,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.07642,"completed_at":"2026-09-14T08:36:34.791Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 140.698585] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.793Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9e4e97c1991a330c08eb945b","created_at":"2026-09-14T08:36:34.705Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"068512d8ef2063c663aba7f4b98246be","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T08:36:34.713Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9e4e97c1991a330c08eb945b: start","job_status":"start","queue_duration_s":0.080434,"scheduling_latency_s":0.080451}1323gitlab # [ 140.710183] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9e4e97c1991a330c08eb945b","created_at":"2026-09-14T08:36:34.705Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"068512d8ef2063c663aba7f4b98246be","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T08:36:34.713Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9e4e97c1991a330c08eb945b: done: 0.042761 sec","job_status":"done","queue_duration_s":0.080434,"scheduling_latency_s":0.080451,"redis_calls":10,"redis_duration_s":0.002426,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068221,"duration_s":0.042761,"completed_at":"2026-09-14T08:36:34.836Z","load_balancing_strategy":"primary","db_duration_s":0.018747,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 140.761113] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4c02463a6b082af7a317f020","created_at":"2026-09-14T08:36:34.717Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87528681b340bfc0195c259236a6ee6f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.722Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4c02463a6b082af7a317f020: start","job_status":"start","queue_duration_s":0.116325,"scheduling_latency_s":0.116339}1325gitlab # [ 140.761785] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.869Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4c02463a6b082af7a317f020","created_at":"2026-09-14T08:36:34.717Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87528681b340bfc0195c259236a6ee6f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.722Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4c02463a6b082af7a317f020: done: 0.030685 sec","job_status":"done","queue_duration_s":0.116325,"scheduling_latency_s":0.116339,"redis_calls":12,"redis_duration_s":0.009784000000000001,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000519,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003434,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000876648,"exclusive_lock_hold_duration_s":0.005615239,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.030685,"completed_at":"2026-09-14T08:36:34.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003087,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 140.810936] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"a831050c0fab32cf3a75f7ef","created_at":"2026-09-14T08:36:34.732Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a4f1b8acafa8042a6afd3950c4db9a2","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.738Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-a831050c0fab32cf3a75f7ef: start","job_status":"start","queue_duration_s":0.135276,"scheduling_latency_s":0.135291}1327gitlab # [ 140.811717] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"a831050c0fab32cf3a75f7ef","created_at":"2026-09-14T08:36:34.732Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a4f1b8acafa8042a6afd3950c4db9a2","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.738Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-a831050c0fab32cf3a75f7ef: done: 0.031644 sec","job_status":"done","queue_duration_s":0.135276,"scheduling_latency_s":0.135291,"redis_calls":10,"redis_duration_s":0.005489,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001686,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000803454,"duration_s":0.031644,"completed_at":"2026-09-14T08:36:34.905Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008758,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 140.877921] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fb87961958d55062e7d38a7b","created_at":"2026-09-14T08:36:34.745Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9360883713ea13fef59333fc8e7a192a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.751Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fb87961958d55062e7d38a7b: start","job_status":"start","queue_duration_s":0.157083,"scheduling_latency_s":0.157099}1329gitlab # [ 140.878609] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.918Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1330gitlab # [ 140.879203] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fb87961958d55062e7d38a7b","created_at":"2026-09-14T08:36:34.745Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9360883713ea13fef59333fc8e7a192a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.751Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fb87961958d55062e7d38a7b: done: 0.021778 sec","job_status":"done","queue_duration_s":0.157083,"scheduling_latency_s":0.157099,"redis_calls":10,"redis_duration_s":0.009099,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000411,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006975,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001713,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000521016,"duration_s":0.021778,"completed_at":"2026-09-14T08:36:34.929Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000375,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 140.900612] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:34.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ecc64f8e5785833a057c58c2","created_at":"2026-09-14T08:36:34.755Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7513082b9bcbb962dee64e5526107f54","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.769Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ecc64f8e5785833a057c58c2: start","job_status":"start","queue_duration_s":0.16429,"scheduling_latency_s":0.164304}1332gitlab # [ 140.913336] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ecc64f8e5785833a057c58c2","created_at":"2026-09-14T08:36:34.755Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7513082b9bcbb962dee64e5526107f54","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.769Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ecc64f8e5785833a057c58c2: done: 0.186138 sec","job_status":"done","queue_duration_s":0.16429,"scheduling_latency_s":0.164304,"redis_calls":14,"redis_duration_s":0.010255,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000881,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008541,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002315378,"exclusive_lock_hold_duration_s":0.156333277,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.186138,"completed_at":"2026-09-14T08:36:35.120Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.071519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 140.959188] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"463a90d7086a0e06f88d1751","created_at":"2026-09-14T08:36:34.774Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"347fa19e1b8e1709dbc7852e70f83cdb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.780Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-463a90d7086a0e06f88d1751: start","job_status":"start","queue_duration_s":0.34073,"scheduling_latency_s":0.340746}1334gitlab # [ 140.964991] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.129Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1335gitlab # [ 140.968459] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"463a90d7086a0e06f88d1751","created_at":"2026-09-14T08:36:34.774Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"347fa19e1b8e1709dbc7852e70f83cdb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.780Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-463a90d7086a0e06f88d1751: done: 0.012595 sec","job_status":"done","queue_duration_s":0.34073,"scheduling_latency_s":0.340746,"redis_calls":10,"redis_duration_s":0.00134,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209245,"duration_s":0.012595,"completed_at":"2026-09-14T08:36:35.133Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 141.023922] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.134Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"1c582f1094f8127beb244972","created_at":"2026-09-14T08:36:34.789Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"392cdb791ec6351d285b20d1c6ad6b16","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.794Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-1c582f1094f8127beb244972: start","job_status":"start","queue_duration_s":0.340178,"scheduling_latency_s":0.340191}1337gitlab # [ 141.024714] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.151Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"1c582f1094f8127beb244972","created_at":"2026-09-14T08:36:34.789Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"392cdb791ec6351d285b20d1c6ad6b16","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.794Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-1c582f1094f8127beb244972: done: 0.016334 sec","job_status":"done","queue_duration_s":0.340178,"scheduling_latency_s":0.340191,"redis_calls":12,"redis_duration_s":0.001637,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00024,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000703,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000314286,"exclusive_lock_hold_duration_s":0.004181258,"duration_s":0.016334,"completed_at":"2026-09-14T08:36:35.151Z","load_balancing_strategy":"primary","db_duration_s":0.001842,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 141.074160] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.152Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"3f2dce322ff5e56752bbd7fc","created_at":"2026-09-14T08:36:34.826Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14210bcaa477ea9a1570d94bab33da31","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.835Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-3f2dce322ff5e56752bbd7fc: start","job_status":"start","queue_duration_s":0.316527,"scheduling_latency_s":0.31654}1339gitlab # [ 141.074899] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.171Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"3f2dce322ff5e56752bbd7fc","created_at":"2026-09-14T08:36:34.826Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14210bcaa477ea9a1570d94bab33da31","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.835Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-3f2dce322ff5e56752bbd7fc: done: 0.018722 sec","job_status":"done","queue_duration_s":0.316527,"scheduling_latency_s":0.31654,"redis_calls":13,"redis_duration_s":0.001696,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005434769,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.018722,"completed_at":"2026-09-14T08:36:35.170Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001411,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1340gitlab # [ 141.121708] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.171Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c63eb3da4d8a7a3dbc86cd06","created_at":"2026-09-14T08:36:34.841Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2821cfbc46c44c0e8cb5366f8c8584a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.849Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c63eb3da4d8a7a3dbc86cd06: start","job_status":"start","queue_duration_s":0.322763,"scheduling_latency_s":0.322776}1341gitlab # [ 141.122512] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c63eb3da4d8a7a3dbc86cd06","created_at":"2026-09-14T08:36:34.841Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2821cfbc46c44c0e8cb5366f8c8584a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.849Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c63eb3da4d8a7a3dbc86cd06: done: 0.012103 sec","job_status":"done","queue_duration_s":0.322763,"scheduling_latency_s":0.322776,"redis_calls":10,"redis_duration_s":0.00123,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019807,"duration_s":0.012103,"completed_at":"2026-09-14T08:36:35.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 141.164275] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ca233d3ce3e402d2ed5f8963","created_at":"2026-09-14T08:36:34.854Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1bc165eef756f297d2429b803cd23ec","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.861Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ca233d3ce3e402d2ed5f8963: start","job_status":"start","queue_duration_s":0.323578,"scheduling_latency_s":0.323591}1343gitlab # [ 141.172046] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.412Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ca233d3ce3e402d2ed5f8963","created_at":"2026-09-14T08:36:34.854Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1bc165eef756f297d2429b803cd23ec","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.861Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ca233d3ce3e402d2ed5f8963: done: 0.22794 sec","job_status":"done","queue_duration_s":0.323578,"scheduling_latency_s":0.323591,"redis_calls":565,"redis_duration_s":0.064724,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.063709,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.177289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220699,"duration_s":0.22794,"completed_at":"2026-09-14T08:36:35.412Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 141.217670] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1da58b8bab652d98003b23a5","created_at":"2026-09-14T08:36:34.874Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab615b0d4189a8d478b8d74bf05af398","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.881Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1da58b8bab652d98003b23a5: start","job_status":"start","queue_duration_s":0.534489,"scheduling_latency_s":0.534504}1345gitlab # [ 141.222207] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.424Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1346gitlab # [ 141.225488] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.429Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1da58b8bab652d98003b23a5","created_at":"2026-09-14T08:36:34.874Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab615b0d4189a8d478b8d74bf05af398","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.881Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1da58b8bab652d98003b23a5: done: 0.013496 sec","job_status":"done","queue_duration_s":0.534489,"scheduling_latency_s":0.534504,"redis_calls":10,"redis_duration_s":0.001261,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198628,"duration_s":0.013496,"completed_at":"2026-09-14T08:36:35.429Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000443,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 141.283716] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.430Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"11c7b20003eb247b3ab77b9a","created_at":"2026-09-14T08:36:34.892Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80d99b5c1cb41010cc1a80a00289012e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.898Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-11c7b20003eb247b3ab77b9a: start","job_status":"start","queue_duration_s":0.531509,"scheduling_latency_s":0.531522}1348gitlab # [ 141.284569] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"11c7b20003eb247b3ab77b9a","created_at":"2026-09-14T08:36:34.892Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80d99b5c1cb41010cc1a80a00289012e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.898Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-11c7b20003eb247b3ab77b9a: done: 0.0128 sec","job_status":"done","queue_duration_s":0.531509,"scheduling_latency_s":0.531522,"redis_calls":12,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000295,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189409,"duration_s":0.0128,"completed_at":"2026-09-14T08:36:35.442Z","load_balancing_strategy":"primary","db_duration_s":0.000231,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 141.325114] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.443Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"89f57464bab282c71364b874","created_at":"2026-09-14T08:36:34.908Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"663e20284e50f0f2761aa46ec1e3c3bb","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.915Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-89f57464bab282c71364b874: start","job_status":"start","queue_duration_s":0.528573,"scheduling_latency_s":0.528586}1350gitlab # [ 141.325421] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"89f57464bab282c71364b874","created_at":"2026-09-14T08:36:34.908Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"663e20284e50f0f2761aa46ec1e3c3bb","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.915Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-89f57464bab282c71364b874: done: 0.021111 sec","job_status":"done","queue_duration_s":0.528573,"scheduling_latency_s":0.528586,"redis_calls":10,"redis_duration_s":0.001448,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000355,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213994,"extra.ci_runners_stale_machines_cleanup_cron_worker.status":"success","extra.ci_runners_stale_machines_cleanup_cron_worker.total_deleted":0,"extra.ci_runners_stale_machines_cleanup_cron_worker.batch_counts":[0],"duration_s":0.021111,"completed_at":"2026-09-14T08:36:35.464Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 141.367930] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.466Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"68d282b6ac15b1f8b08362d8","created_at":"2026-09-14T08:36:34.923Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"572b8e7b07b4cf5f5a2f529ec9596ae2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.930Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-68d282b6ac15b1f8b08362d8: start","job_status":"start","queue_duration_s":0.535083,"scheduling_latency_s":0.535096}1352gitlab # [ 141.409675] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"68d282b6ac15b1f8b08362d8","created_at":"2026-09-14T08:36:34.923Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"572b8e7b07b4cf5f5a2f529ec9596ae2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.930Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-68d282b6ac15b1f8b08362d8: done: 0.031357 sec","job_status":"done","queue_duration_s":0.535083,"scheduling_latency_s":0.535096,"redis_calls":14,"redis_duration_s":0.002061,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000543,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000664,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000349206,"exclusive_lock_hold_duration_s":0.017139050000000003,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.031357,"completed_at":"2026-09-14T08:36:35.497Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011815,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 141.416047] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c5a857ba58753de8cb33e350","created_at":"2026-09-14T08:36:34.947Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c81eedba72c8f45c6d21b5fb7457b87d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T08:36:34.952Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c5a857ba58753de8cb33e350: start","job_status":"start","queue_duration_s":0.546306,"scheduling_latency_s":0.54632}1354gitlab # [ 141.428474] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.506Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1355gitlab # [ 141.431666] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c5a857ba58753de8cb33e350","created_at":"2026-09-14T08:36:34.947Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c81eedba72c8f45c6d21b5fb7457b87d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T08:36:34.952Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c5a857ba58753de8cb33e350: done: 0.012414 sec","job_status":"done","queue_duration_s":0.546306,"scheduling_latency_s":0.54632,"redis_calls":10,"redis_duration_s":0.001241,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000199746,"duration_s":0.012414,"completed_at":"2026-09-14T08:36:35.511Z","load_balancing_strategy":"primary","db_duration_s":0.000273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 141.481538] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.511Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2cb3bbe90f013677071c898f","created_at":"2026-09-14T08:36:34.956Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc083ce5945852c0b325403af95ef9cc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.959Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2cb3bbe90f013677071c898f: start","job_status":"start","queue_duration_s":0.552291,"scheduling_latency_s":0.552304}1357gitlab # [ 141.482293] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.531Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2cb3bbe90f013677071c898f","created_at":"2026-09-14T08:36:34.956Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc083ce5945852c0b325403af95ef9cc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.959Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2cb3bbe90f013677071c898f: done: 0.019414 sec","job_status":"done","queue_duration_s":0.552291,"scheduling_latency_s":0.552304,"redis_calls":16,"redis_duration_s":0.002191,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001135,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00020254,"duration_s":0.019414,"completed_at":"2026-09-14T08:36:35.531Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 141.525994] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c8c72c797694e5499bac036e","created_at":"2026-09-14T08:36:34.963Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d54249fe98e2a55e7b687d0c46ce860d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.971Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c8c72c797694e5499bac036e: start","job_status":"start","queue_duration_s":0.560843,"scheduling_latency_s":0.560856}1359gitlab # [ 141.531201] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.539Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1360gitlab # [ 141.534413] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c8c72c797694e5499bac036e","created_at":"2026-09-14T08:36:34.963Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d54249fe98e2a55e7b687d0c46ce860d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.971Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c8c72c797694e5499bac036e: done: 0.011854 sec","job_status":"done","queue_duration_s":0.560843,"scheduling_latency_s":0.560856,"redis_calls":10,"redis_duration_s":0.0012820000000000002,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191086,"duration_s":0.011854,"completed_at":"2026-09-14T08:36:35.544Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 141.608581] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.545Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"475e7635b04131cea957ab78","created_at":"2026-09-14T08:36:34.973Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.977Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-475e7635b04131cea957ab78: start","job_status":"start","queue_duration_s":0.567302,"scheduling_latency_s":0.567315}1362gitlab # [ 141.609523] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"475e7635b04131cea957ab78","created_at":"2026-09-14T08:36:34.973Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.977Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-475e7635b04131cea957ab78: done: 0.064081 sec","job_status":"done","queue_duration_s":0.567302,"scheduling_latency_s":0.567315,"redis_calls":71,"redis_duration_s":0.009838,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001469,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00068,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007319,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00037,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000253663,"duration_s":0.064081,"completed_at":"2026-09-14T08:36:35.609Z","load_balancing_strategy":"primary","db_duration_s":0.001039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 141.623740] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.610Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"82d0dc4dc26dc3ca9df75453","created_at":"2026-09-14T08:36:34.979Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"64fbb56edf4f02de2c4e37b980d1edaf","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.986Z","job_size_bytes":3,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-82d0dc4dc26dc3ca9df75453: start","job_status":"start","queue_duration_s":0.623707,"scheduling_latency_s":0.623721}1364gitlab # [ 141.636240] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.622Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"82d0dc4dc26dc3ca9df75453","created_at":"2026-09-14T08:36:34.979Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"64fbb56edf4f02de2c4e37b980d1edaf","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.986Z","job_size_bytes":3,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-82d0dc4dc26dc3ca9df75453: done: 0.012666 sec","job_status":"done","queue_duration_s":0.623707,"scheduling_latency_s":0.623721,"redis_calls":10,"redis_duration_s":0.001288,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200026,"duration_s":0.012666,"completed_at":"2026-09-14T08:36:35.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 141.689690] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"192372923021fe24ddcaa95c","created_at":"2026-09-14T08:36:34.988Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"964dde7b05f7c96ed52b749eeeeb38ef","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.992Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-192372923021fe24ddcaa95c: start","job_status":"start","queue_duration_s":0.631469,"scheduling_latency_s":0.631481}1366gitlab # [ 141.690688] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"192372923021fe24ddcaa95c","created_at":"2026-09-14T08:36:34.988Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"964dde7b05f7c96ed52b749eeeeb38ef","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:34.992Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-192372923021fe24ddcaa95c: done: 0.015368 sec","job_status":"done","queue_duration_s":0.631469,"scheduling_latency_s":0.631481,"redis_calls":12,"redis_duration_s":0.001555,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000308978,"exclusive_lock_hold_duration_s":0.0033029329999999997,"duration_s":0.015368,"completed_at":"2026-09-14T08:36:35.639Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 141.732971] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"fed76aa74257091e9e171276","created_at":"2026-09-14T08:36:34.995Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6413c671a3672c8ce17ff4bff1261f08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.000Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-fed76aa74257091e9e171276: start","job_status":"start","queue_duration_s":0.639427,"scheduling_latency_s":0.63944}1368gitlab # [ 141.735122] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"fed76aa74257091e9e171276","created_at":"2026-09-14T08:36:34.995Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6413c671a3672c8ce17ff4bff1261f08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.000Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-fed76aa74257091e9e171276: done: 0.021758 sec","job_status":"done","queue_duration_s":0.639427,"scheduling_latency_s":0.63944,"redis_calls":20,"redis_duration_s":0.002389,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.000996,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000169,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000373,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217625,"duration_s":0.021758,"completed_at":"2026-09-14T08:36:35.661Z","load_balancing_strategy":"primary","db_duration_s":0.000856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 141.774138] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fa9ff735c4c667807e30819","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fa9ff735c4c667807e30819: start","job_status":"start","queue_duration_s":0.060142,"scheduling_latency_s":0.060155}1370gitlab # [ 141.817803] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fa9ff735c4c667807e30819","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fa9ff735c4c667807e30819: done: 0.014315 sec","job_status":"done","queue_duration_s":0.060142,"scheduling_latency_s":0.060155,"redis_calls":16,"redis_duration_s":0.001955,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204495,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014315,"completed_at":"2026-09-14T08:36:35.677Z","load_balancing_strategy":"primary","db_duration_s":0.000238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 141.859794] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5415af8a72eff959e07ff9fc","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5415af8a72eff959e07ff9fc: start","job_status":"start","queue_duration_s":0.075429,"scheduling_latency_s":0.075443}1372gitlab # [ 141.860662] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5415af8a72eff959e07ff9fc","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5415af8a72eff959e07ff9fc: done: 0.009808 sec","job_status":"done","queue_duration_s":0.075429,"scheduling_latency_s":0.075443,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009808,"completed_at":"2026-09-14T08:36:35.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 141.867872] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9373449e970103bc010bd4aa","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9373449e970103bc010bd4aa: start","job_status":"start","queue_duration_s":0.086218,"scheduling_latency_s":0.086231}1374gitlab # [ 141.878946] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9373449e970103bc010bd4aa","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9373449e970103bc010bd4aa: done: 0.009432 sec","job_status":"done","queue_duration_s":0.086218,"scheduling_latency_s":0.086231,"redis_calls":13,"redis_duration_s":0.00154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009432,"completed_at":"2026-09-14T08:36:35.698Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 141.924801] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96836fb887ccd3628d6bd187","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96836fb887ccd3628d6bd187: start","job_status":"start","queue_duration_s":0.09672,"scheduling_latency_s":0.096733}1376gitlab # [ 141.926134] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96836fb887ccd3628d6bd187","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96836fb887ccd3628d6bd187: done: 0.009535 sec","job_status":"done","queue_duration_s":0.09672,"scheduling_latency_s":0.096733,"redis_calls":13,"redis_duration_s":0.001499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009535,"completed_at":"2026-09-14T08:36:35.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 141.966555] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6865ba176e4b38352c49d548","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6865ba176e4b38352c49d548: start","job_status":"start","queue_duration_s":0.107085,"scheduling_latency_s":0.107098}1378gitlab # [ 141.971544] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6865ba176e4b38352c49d548","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6865ba176e4b38352c49d548: done: 0.009592 sec","job_status":"done","queue_duration_s":0.107085,"scheduling_latency_s":0.107098,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009592,"completed_at":"2026-09-14T08:36:35.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 142.021126] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67446108ffd90fbddf923b9d","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67446108ffd90fbddf923b9d: start","job_status":"start","queue_duration_s":0.117471,"scheduling_latency_s":0.117484}1380gitlab # [ 142.021782] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67446108ffd90fbddf923b9d","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67446108ffd90fbddf923b9d: done: 0.009703 sec","job_status":"done","queue_duration_s":0.117471,"scheduling_latency_s":0.117484,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009703,"completed_at":"2026-09-14T08:36:35.729Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 142.064904] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45ea1be930fc485d91b1df5c","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45ea1be930fc485d91b1df5c: start","job_status":"start","queue_duration_s":0.127957,"scheduling_latency_s":0.127995}1382gitlab # [ 142.065657] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45ea1be930fc485d91b1df5c","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45ea1be930fc485d91b1df5c: done: 0.009768 sec","job_status":"done","queue_duration_s":0.127957,"scheduling_latency_s":0.127995,"redis_calls":13,"redis_duration_s":0.001541,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009768,"completed_at":"2026-09-14T08:36:35.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 142.096683] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a087b4d5f9bddcf2e8f1093a","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a087b4d5f9bddcf2e8f1093a: start","job_status":"start","queue_duration_s":0.138549,"scheduling_latency_s":0.138561}1384gitlab # [ 142.107663] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a087b4d5f9bddcf2e8f1093a","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a087b4d5f9bddcf2e8f1093a: done: 0.056008 sec","job_status":"done","queue_duration_s":0.138549,"scheduling_latency_s":0.138561,"redis_calls":13,"redis_duration_s":0.001729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.056008,"completed_at":"2026-09-14T08:36:35.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 142.161126] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bca18e6af901bab50bcd2c1d","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bca18e6af901bab50bcd2c1d: start","job_status":"start","queue_duration_s":0.195511,"scheduling_latency_s":0.195528}1386gitlab # [ 142.161743] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bca18e6af901bab50bcd2c1d","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bca18e6af901bab50bcd2c1d: done: 0.009807 sec","job_status":"done","queue_duration_s":0.195511,"scheduling_latency_s":0.195528,"redis_calls":13,"redis_duration_s":0.001662,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009807,"completed_at":"2026-09-14T08:36:35.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 142.200147] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c317c60ad2eac7cca1984ca6","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c317c60ad2eac7cca1984ca6: start","job_status":"start","queue_duration_s":0.206115,"scheduling_latency_s":0.206128}1388gitlab # [ 142.200737] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c317c60ad2eac7cca1984ca6","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c317c60ad2eac7cca1984ca6: done: 0.008916 sec","job_status":"done","queue_duration_s":0.206115,"scheduling_latency_s":0.206128,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008916,"completed_at":"2026-09-14T08:36:35.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 142.253030] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2a64cb8771399a24e8f4562","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2a64cb8771399a24e8f4562: start","job_status":"start","queue_duration_s":0.215837,"scheduling_latency_s":0.215849}1390gitlab # [ 142.253685] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2a64cb8771399a24e8f4562","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2a64cb8771399a24e8f4562: done: 0.00901 sec","job_status":"done","queue_duration_s":0.215837,"scheduling_latency_s":0.215849,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00901,"completed_at":"2026-09-14T08:36:35.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 142.299259] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"704ba1b99cb32961dd2e96d3","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-704ba1b99cb32961dd2e96d3: start","job_status":"start","queue_duration_s":0.225918,"scheduling_latency_s":0.225931}1392gitlab # [ 142.300122] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"704ba1b99cb32961dd2e96d3","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-704ba1b99cb32961dd2e96d3: done: 0.009128 sec","job_status":"done","queue_duration_s":0.225918,"scheduling_latency_s":0.225931,"redis_calls":13,"redis_duration_s":0.0014789999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009128,"completed_at":"2026-09-14T08:36:35.837Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 142.347685] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a08e535fbd31c68f9d60a1d","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a08e535fbd31c68f9d60a1d: start","job_status":"start","queue_duration_s":0.235842,"scheduling_latency_s":0.235854}1394gitlab # [ 142.348469] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a08e535fbd31c68f9d60a1d","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a08e535fbd31c68f9d60a1d: done: 0.009229 sec","job_status":"done","queue_duration_s":0.235842,"scheduling_latency_s":0.235854,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009229,"completed_at":"2026-09-14T08:36:35.847Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 142.390481] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31223097b9a40fd543faacdc","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31223097b9a40fd543faacdc: start","job_status":"start","queue_duration_s":0.245859,"scheduling_latency_s":0.245872}1396gitlab # [ 142.391078] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31223097b9a40fd543faacdc","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31223097b9a40fd543faacdc: done: 0.009064 sec","job_status":"done","queue_duration_s":0.245859,"scheduling_latency_s":0.245872,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009064,"completed_at":"2026-09-14T08:36:35.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 142.412455] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b45fd9d2e35afe805594eba7","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b45fd9d2e35afe805594eba7: start","job_status":"start","queue_duration_s":0.255917,"scheduling_latency_s":0.25593}1398gitlab # [ 142.451673] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b45fd9d2e35afe805594eba7","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b45fd9d2e35afe805594eba7: done: 0.009193 sec","job_status":"done","queue_duration_s":0.255917,"scheduling_latency_s":0.25593,"redis_calls":13,"redis_duration_s":0.0015110000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009193,"completed_at":"2026-09-14T08:36:35.867Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 142.492483] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2f02b231867abc411795e93","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2f02b231867abc411795e93: start","job_status":"start","queue_duration_s":0.266277,"scheduling_latency_s":0.26629}1400gitlab # [ 142.493217] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2f02b231867abc411795e93","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2f02b231867abc411795e93: done: 0.009323 sec","job_status":"done","queue_duration_s":0.266277,"scheduling_latency_s":0.26629,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009323,"completed_at":"2026-09-14T08:36:35.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 142.538757] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"054a096b847e6fecfd30f3d1","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-054a096b847e6fecfd30f3d1: start","job_status":"start","queue_duration_s":0.276428,"scheduling_latency_s":0.276442}1402gitlab # [ 142.539115] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"054a096b847e6fecfd30f3d1","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-054a096b847e6fecfd30f3d1: done: 0.009285 sec","job_status":"done","queue_duration_s":0.276428,"scheduling_latency_s":0.276442,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009285,"completed_at":"2026-09-14T08:36:35.888Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 142.582467] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e5713a5d6466e08ac00ba14","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e5713a5d6466e08ac00ba14: start","job_status":"start","queue_duration_s":0.286522,"scheduling_latency_s":0.286535}1404gitlab # [ 142.583245] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e5713a5d6466e08ac00ba14","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e5713a5d6466e08ac00ba14: done: 0.009359 sec","job_status":"done","queue_duration_s":0.286522,"scheduling_latency_s":0.286535,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009359,"completed_at":"2026-09-14T08:36:35.898Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 142.627291] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fea055fa1772dd869d7f2c1","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fea055fa1772dd869d7f2c1: start","job_status":"start","queue_duration_s":0.296797,"scheduling_latency_s":0.29715}1406gitlab # [ 142.627957] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fea055fa1772dd869d7f2c1","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fea055fa1772dd869d7f2c1: done: 0.009576 sec","job_status":"done","queue_duration_s":0.296797,"scheduling_latency_s":0.29715,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009576,"completed_at":"2026-09-14T08:36:35.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 142.669612] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4e350faf72b063c753f7912","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4e350faf72b063c753f7912: start","job_status":"start","queue_duration_s":0.307189,"scheduling_latency_s":0.307202}1408gitlab # [ 142.670520] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4e350faf72b063c753f7912","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4e350faf72b063c753f7912: done: 0.00943 sec","job_status":"done","queue_duration_s":0.307189,"scheduling_latency_s":0.307202,"redis_calls":13,"redis_duration_s":0.001943,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001458,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00943,"completed_at":"2026-09-14T08:36:35.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 142.710695] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d40e3798d556067ea79e9789","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d40e3798d556067ea79e9789: start","job_status":"start","queue_duration_s":0.317435,"scheduling_latency_s":0.317448}1410gitlab # [ 142.711483] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d40e3798d556067ea79e9789","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d40e3798d556067ea79e9789: done: 0.00935 sec","job_status":"done","queue_duration_s":0.317435,"scheduling_latency_s":0.317448,"redis_calls":13,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00935,"completed_at":"2026-09-14T08:36:35.929Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 142.750948] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d06177dceb3ac85b42a30e33","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d06177dceb3ac85b42a30e33: start","job_status":"start","queue_duration_s":0.327602,"scheduling_latency_s":0.327616}1412gitlab # [ 142.751563] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d06177dceb3ac85b42a30e33","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d06177dceb3ac85b42a30e33: done: 0.009718 sec","job_status":"done","queue_duration_s":0.327602,"scheduling_latency_s":0.327616,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009718,"completed_at":"2026-09-14T08:36:35.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 142.800682] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0e44c0aad006847de501320","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0e44c0aad006847de501320: start","job_status":"start","queue_duration_s":0.338398,"scheduling_latency_s":0.33841}1414gitlab # [ 142.801640] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0e44c0aad006847de501320","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0e44c0aad006847de501320: done: 0.009203 sec","job_status":"done","queue_duration_s":0.338398,"scheduling_latency_s":0.33841,"redis_calls":13,"redis_duration_s":0.0015340000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009203,"completed_at":"2026-09-14T08:36:35.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 142.819963] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ad1a04f14ed71f65a128263","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ad1a04f14ed71f65a128263: start","job_status":"start","queue_duration_s":0.348425,"scheduling_latency_s":0.348438}1416gitlab # [ 142.862928] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ad1a04f14ed71f65a128263","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ad1a04f14ed71f65a128263: done: 0.009476 sec","job_status":"done","queue_duration_s":0.348425,"scheduling_latency_s":0.348438,"redis_calls":13,"redis_duration_s":0.0016740000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009476,"completed_at":"2026-09-14T08:36:35.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 142.865633] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d12dac8c8a5c8034cfe0ffd","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d12dac8c8a5c8034cfe0ffd: start","job_status":"start","queue_duration_s":0.35873,"scheduling_latency_s":0.358743}1418gitlab # [ 142.908748] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d12dac8c8a5c8034cfe0ffd","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d12dac8c8a5c8034cfe0ffd: done: 0.009118 sec","job_status":"done","queue_duration_s":0.35873,"scheduling_latency_s":0.358743,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009118,"completed_at":"2026-09-14T08:36:35.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 142.911749] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2727b12b78f854a2cf15538e","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2727b12b78f854a2cf15538e: start","job_status":"start","queue_duration_s":0.368643,"scheduling_latency_s":0.368656}1420gitlab # [ 142.959744] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2727b12b78f854a2cf15538e","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2727b12b78f854a2cf15538e: done: 0.009382 sec","job_status":"done","queue_duration_s":0.368643,"scheduling_latency_s":0.368656,"redis_calls":13,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009382,"completed_at":"2026-09-14T08:36:35.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 142.960507] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a19dcdd995c8c2457d34c040","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a19dcdd995c8c2457d34c040: start","job_status":"start","queue_duration_s":0.379314,"scheduling_latency_s":0.379328}1422gitlab # [ 143.006666] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a19dcdd995c8c2457d34c040","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a19dcdd995c8c2457d34c040: done: 0.009217 sec","job_status":"done","queue_duration_s":0.379314,"scheduling_latency_s":0.379328,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009217,"completed_at":"2026-09-14T08:36:35.991Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 143.007685] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:35.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73e032225012c63e33846ab0","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73e032225012c63e33846ab0: start","job_status":"start","queue_duration_s":0.389346,"scheduling_latency_s":0.389359}1424gitlab # [ 143.015874] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73e032225012c63e33846ab0","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73e032225012c63e33846ab0: done: 0.009279 sec","job_status":"done","queue_duration_s":0.389346,"scheduling_latency_s":0.389359,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009279,"completed_at":"2026-09-14T08:36:36.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 143.056063] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c041a4b4b45d1ca4144ba50","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c041a4b4b45d1ca4144ba50: start","job_status":"start","queue_duration_s":0.399505,"scheduling_latency_s":0.399519}1426gitlab # [ 143.062517] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c041a4b4b45d1ca4144ba50","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c041a4b4b45d1ca4144ba50: done: 0.009193 sec","job_status":"done","queue_duration_s":0.399505,"scheduling_latency_s":0.399519,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009193,"completed_at":"2026-09-14T08:36:36.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 143.104989] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1190d92a3ad01912d51b25c5","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1190d92a3ad01912d51b25c5: start","job_status":"start","queue_duration_s":0.409836,"scheduling_latency_s":0.409849}1428gitlab # [ 143.108577] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1190d92a3ad01912d51b25c5","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1190d92a3ad01912d51b25c5: done: 0.009187 sec","job_status":"done","queue_duration_s":0.409836,"scheduling_latency_s":0.409849,"redis_calls":13,"redis_duration_s":0.001449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009187,"completed_at":"2026-09-14T08:36:36.021Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 143.148665] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89e531c4d2542a851961751f","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89e531c4d2542a851961751f: start","job_status":"start","queue_duration_s":0.419808,"scheduling_latency_s":0.419821}1430gitlab # [ 143.153505] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89e531c4d2542a851961751f","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89e531c4d2542a851961751f: done: 0.009062 sec","job_status":"done","queue_duration_s":0.419808,"scheduling_latency_s":0.419821,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009062,"completed_at":"2026-09-14T08:36:36.031Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 143.198248] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7946f3b2937e3105af716267","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7946f3b2937e3105af716267: start","job_status":"start","queue_duration_s":0.429674,"scheduling_latency_s":0.429686}1432gitlab # [ 143.198889] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7946f3b2937e3105af716267","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7946f3b2937e3105af716267: done: 0.009164 sec","job_status":"done","queue_duration_s":0.429674,"scheduling_latency_s":0.429686,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009164,"completed_at":"2026-09-14T08:36:36.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 143.252975] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfb13085607021e47cc7196d","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfb13085607021e47cc7196d: start","job_status":"start","queue_duration_s":0.440007,"scheduling_latency_s":0.44002}1434gitlab # [ 143.253598] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfb13085607021e47cc7196d","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfb13085607021e47cc7196d: done: 0.00908 sec","job_status":"done","queue_duration_s":0.440007,"scheduling_latency_s":0.44002,"redis_calls":13,"redis_duration_s":0.0014830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00908,"completed_at":"2026-09-14T08:36:36.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 143.296071] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b08febc9f812f469d3a2ccc","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b08febc9f812f469d3a2ccc: start","job_status":"start","queue_duration_s":0.449836,"scheduling_latency_s":0.44985}1436gitlab # [ 143.296767] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b08febc9f812f469d3a2ccc","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b08febc9f812f469d3a2ccc: done: 0.009622 sec","job_status":"done","queue_duration_s":0.449836,"scheduling_latency_s":0.44985,"redis_calls":13,"redis_duration_s":0.001693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001201,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009622,"completed_at":"2026-09-14T08:36:36.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 143.359662] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b996cc6817954e6383d47396","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b996cc6817954e6383d47396: start","job_status":"start","queue_duration_s":0.460296,"scheduling_latency_s":0.46031}1438gitlab # [ 143.360628] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b996cc6817954e6383d47396","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b996cc6817954e6383d47396: done: 0.009303 sec","job_status":"done","queue_duration_s":0.460296,"scheduling_latency_s":0.46031,"redis_calls":13,"redis_duration_s":0.001914,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009303,"completed_at":"2026-09-14T08:36:36.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 143.368660] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"936d4ee98383aaff210e0128","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-936d4ee98383aaff210e0128: start","job_status":"start","queue_duration_s":0.47046,"scheduling_latency_s":0.470473}1440gitlab # [ 143.408648] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"936d4ee98383aaff210e0128","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-936d4ee98383aaff210e0128: done: 0.009465 sec","job_status":"done","queue_duration_s":0.47046,"scheduling_latency_s":0.470473,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009465,"completed_at":"2026-09-14T08:36:36.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 143.413729] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84d3af95c54fe68934315444","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84d3af95c54fe68934315444: start","job_status":"start","queue_duration_s":0.480767,"scheduling_latency_s":0.48078}1442gitlab # [ 143.456324] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84d3af95c54fe68934315444","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84d3af95c54fe68934315444: done: 0.013263 sec","job_status":"done","queue_duration_s":0.480767,"scheduling_latency_s":0.48078,"redis_calls":13,"redis_duration_s":0.001873,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013263,"completed_at":"2026-09-14T08:36:36.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 143.459620] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a00bafd236d7c80f8908c274","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a00bafd236d7c80f8908c274: start","job_status":"start","queue_duration_s":0.495137,"scheduling_latency_s":0.495158}1444gitlab # [ 143.498513] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a00bafd236d7c80f8908c274","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a00bafd236d7c80f8908c274: done: 0.010351 sec","job_status":"done","queue_duration_s":0.495137,"scheduling_latency_s":0.495158,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010351,"completed_at":"2026-09-14T08:36:36.108Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 143.504379] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba2f0e4500a703b7c2df8576","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba2f0e4500a703b7c2df8576: start","job_status":"start","queue_duration_s":0.506277,"scheduling_latency_s":0.506289}1446gitlab # [ 143.515692] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba2f0e4500a703b7c2df8576","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba2f0e4500a703b7c2df8576: done: 0.009331 sec","job_status":"done","queue_duration_s":0.506277,"scheduling_latency_s":0.506289,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009331,"completed_at":"2026-09-14T08:36:36.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 143.554245] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee2ec513caf907fe5808709f","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee2ec513caf907fe5808709f: start","job_status":"start","queue_duration_s":0.516424,"scheduling_latency_s":0.516436}1448gitlab # [ 143.560870] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee2ec513caf907fe5808709f","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee2ec513caf907fe5808709f: done: 0.009173 sec","job_status":"done","queue_duration_s":0.516424,"scheduling_latency_s":0.516436,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009173,"completed_at":"2026-09-14T08:36:36.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 143.615701] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8daefb9712e7307a654fd420","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8daefb9712e7307a654fd420: start","job_status":"start","queue_duration_s":0.529264,"scheduling_latency_s":0.529279}1450gitlab # [ 143.616596] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8daefb9712e7307a654fd420","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8daefb9712e7307a654fd420: done: 0.00933 sec","job_status":"done","queue_duration_s":0.529264,"scheduling_latency_s":0.529279,"redis_calls":13,"redis_duration_s":0.0014490000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00933,"completed_at":"2026-09-14T08:36:36.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 143.664134] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fff74c47a2c55af491a03976","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fff74c47a2c55af491a03976: start","job_status":"start","queue_duration_s":0.539682,"scheduling_latency_s":0.539695}1452gitlab # [ 143.664791] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fff74c47a2c55af491a03976","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fff74c47a2c55af491a03976: done: 0.009216 sec","job_status":"done","queue_duration_s":0.539682,"scheduling_latency_s":0.539695,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009216,"completed_at":"2026-09-14T08:36:36.151Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 143.707438] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7ef10464325c27b5869701b","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7ef10464325c27b5869701b: start","job_status":"start","queue_duration_s":0.549708,"scheduling_latency_s":0.549721}1454gitlab # [ 143.708220] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7ef10464325c27b5869701b","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7ef10464325c27b5869701b: done: 0.009583 sec","job_status":"done","queue_duration_s":0.549708,"scheduling_latency_s":0.549721,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009583,"completed_at":"2026-09-14T08:36:36.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 143.729773] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d20ea02ad8bd288e654567b4","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d20ea02ad8bd288e654567b4: start","job_status":"start","queue_duration_s":0.560103,"scheduling_latency_s":0.560116}1456gitlab # [ 143.773626] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d20ea02ad8bd288e654567b4","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d20ea02ad8bd288e654567b4: done: 0.014465 sec","job_status":"done","queue_duration_s":0.560103,"scheduling_latency_s":0.560116,"redis_calls":13,"redis_duration_s":0.006529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001649,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014465,"completed_at":"2026-09-14T08:36:36.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 143.774627] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4be197e0a01df13038dca11","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4be197e0a01df13038dca11: start","job_status":"start","queue_duration_s":0.57594,"scheduling_latency_s":0.575954}1458gitlab # [ 143.821260] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4be197e0a01df13038dca11","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4be197e0a01df13038dca11: done: 0.017433 sec","job_status":"done","queue_duration_s":0.57594,"scheduling_latency_s":0.575954,"redis_calls":13,"redis_duration_s":0.00867,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00246,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00621,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017433,"completed_at":"2026-09-14T08:36:36.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 143.822228] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e77555226f272969f8c0da77","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e77555226f272969f8c0da77: start","job_status":"start","queue_duration_s":0.594577,"scheduling_latency_s":0.594591}1460gitlab # [ 143.829806] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e77555226f272969f8c0da77","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e77555226f272969f8c0da77: done: 0.009382 sec","job_status":"done","queue_duration_s":0.594577,"scheduling_latency_s":0.594591,"redis_calls":13,"redis_duration_s":0.0014680000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009382,"completed_at":"2026-09-14T08:36:36.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 143.879684] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa810b1cdd6ff49e2494c3e5","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa810b1cdd6ff49e2494c3e5: start","job_status":"start","queue_duration_s":0.604763,"scheduling_latency_s":0.604776}1462gitlab # [ 143.880649] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa810b1cdd6ff49e2494c3e5","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa810b1cdd6ff49e2494c3e5: done: 0.009099 sec","job_status":"done","queue_duration_s":0.604763,"scheduling_latency_s":0.604776,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009099,"completed_at":"2026-09-14T08:36:36.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 143.930631] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ac08462f8923ca15f53e997","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ac08462f8923ca15f53e997: start","job_status":"start","queue_duration_s":0.614658,"scheduling_latency_s":0.614672}1464gitlab # [ 143.931433] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ac08462f8923ca15f53e997","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ac08462f8923ca15f53e997: done: 0.009024 sec","job_status":"done","queue_duration_s":0.614658,"scheduling_latency_s":0.614672,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009024,"completed_at":"2026-09-14T08:36:36.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 143.985530] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd1ec4da66512b4c8bd9d41f","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd1ec4da66512b4c8bd9d41f: start","job_status":"start","queue_duration_s":0.62457,"scheduling_latency_s":0.624583}1466gitlab # [ 143.986263] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd1ec4da66512b4c8bd9d41f","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd1ec4da66512b4c8bd9d41f: done: 0.011807 sec","job_status":"done","queue_duration_s":0.62457,"scheduling_latency_s":0.624583,"redis_calls":13,"redis_duration_s":0.004116,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011807,"completed_at":"2026-09-14T08:36:36.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 144.026057] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb5d7ae3e62d4610979aadb7","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb5d7ae3e62d4610979aadb7: start","job_status":"start","queue_duration_s":0.637423,"scheduling_latency_s":0.637436}1468gitlab # [ 144.026652] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb5d7ae3e62d4610979aadb7","created_at":"2026-09-14T08:36:35.557Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-c139776f244c4f6f","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dde1d35c4c9636588350ab8935ef184a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.602Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb5d7ae3e62d4610979aadb7: done: 0.009034 sec","job_status":"done","queue_duration_s":0.637423,"scheduling_latency_s":0.637436,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009034,"completed_at":"2026-09-14T08:36:36.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 144.043490] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"87195c6c87e1a074727978f5","created_at":"2026-09-14T08:36:35.650Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-b81147a607a44b93","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"6413c671a3672c8ce17ff4bff1261f08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.656Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-87195c6c87e1a074727978f5: start","job_status":"start","queue_duration_s":0.593096,"scheduling_latency_s":0.593109}1470gitlab # [ 144.083635] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:36:36.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"87195c6c87e1a074727978f5","created_at":"2026-09-14T08:36:35.650Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-b81147a607a44b93","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"6413c671a3672c8ce17ff4bff1261f08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:36:35.656Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-87195c6c87e1a074727978f5: done: 0.019175 sec","job_status":"done","queue_duration_s":0.593096,"scheduling_latency_s":0.593109,"redis_calls":13,"redis_duration_s":0.0017380000000000002,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201702,"duration_s":0.019175,"completed_at":"2026-09-14T08:36:36.269Z","load_balancing_strategy":"primary","db_duration_s":0.0028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 144.275127] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 3859788298 wd_nsec: 38597881101472gitlab # [ 158.970645] setup-gitlab-start[2210]: W, [2026-09-14T08:36:53.280343 #2210] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1473gitlab # [ 168.027077] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:02.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e00e791ec1bc91163f1f6080","created_at":"2026-09-14T08:37:02.284Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34fdef761895c8fd9682a80d029d9560","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.334Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e00e791ec1bc91163f1f6080: start","job_status":"start","queue_duration_s":0.001968,"scheduling_latency_s":0.002006}1474gitlab # [ 168.192639] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:02.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e00e791ec1bc91163f1f6080","created_at":"2026-09-14T08:37:02.284Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34fdef761895c8fd9682a80d029d9560","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.334Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e00e791ec1bc91163f1f6080: done: 0.166429 sec","job_status":"done","queue_duration_s":0.001968,"scheduling_latency_s":0.002006,"redis_calls":7,"redis_duration_s":0.004488,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.071,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.166429,"completed_at":"2026-09-14T08:37:02.502Z","load_balancing_strategy":"primary","db_duration_s":0.071227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 168.232747] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:02.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"11e2628e2312a85e5165ead0","created_at":"2026-09-14T08:37:02.368Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d461f67e73ff5ba4a61e0f8d3753a81f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.373Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-11e2628e2312a85e5165ead0: start","job_status":"start","queue_duration_s":0.169789,"scheduling_latency_s":0.169817}1476gitlab # [ 168.285082] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:02.594Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"11e2628e2312a85e5165ead0","created_at":"2026-09-14T08:37:02.368Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d461f67e73ff5ba4a61e0f8d3753a81f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.373Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-11e2628e2312a85e5165ead0: done: 0.051822 sec","job_status":"done","queue_duration_s":0.169789,"scheduling_latency_s":0.169817,"redis_calls":7,"redis_duration_s":0.014735000000000002,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001607,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051822,"completed_at":"2026-09-14T08:37:02.594Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 168.328490] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:02.638Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0198eb907c3cbb593ddc7075","created_at":"2026-09-14T08:37:02.443Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88a6981bea28f91549018d1f2d9384f9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T08:37:02.445Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0198eb907c3cbb593ddc7075: start","job_status":"start","queue_duration_s":0.193176,"scheduling_latency_s":0.193201}1478gitlab # [ 168.377092] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:02.687Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1479gitlab # [ 168.391778] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:02.701Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0198eb907c3cbb593ddc7075","created_at":"2026-09-14T08:37:02.443Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88a6981bea28f91549018d1f2d9384f9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T08:37:02.445Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0198eb907c3cbb593ddc7075: done: 0.063077 sec","job_status":"done","queue_duration_s":0.193176,"scheduling_latency_s":0.193201,"redis_calls":7,"redis_duration_s":0.024832,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.02392,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063077,"completed_at":"2026-09-14T08:37:02.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 168.464218] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:02.774Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bc5de6cfa13796499327cf5d","created_at":"2026-09-14T08:37:02.456Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c7f5f13c25caa015469f8148f947f4a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.463Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bc5de6cfa13796499327cf5d: start","job_status":"start","queue_duration_s":0.310333,"scheduling_latency_s":0.310376}1481gitlab # [ 168.763367] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bc5de6cfa13796499327cf5d","created_at":"2026-09-14T08:37:02.456Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c7f5f13c25caa015469f8148f947f4a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.463Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bc5de6cfa13796499327cf5d: done: 0.298306 sec","job_status":"done","queue_duration_s":0.310333,"scheduling_latency_s":0.310376,"redis_calls":14,"redis_duration_s":0.03526,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.001011,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.026988,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.007261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.103,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.103,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.298306,"completed_at":"2026-09-14T08:37:03.072Z","load_balancing_strategy":"primary","db_duration_s":0.171014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 168.843710] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.153Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"7ac1ac3d3a740e898166aa54","created_at":"2026-09-14T08:37:02.538Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53c44ec6027b1f604cec470ac6c926d2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.541Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-7ac1ac3d3a740e898166aa54: start","job_status":"start","queue_duration_s":0.611591,"scheduling_latency_s":0.611633}1483gitlab # [ 168.902815] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"7ac1ac3d3a740e898166aa54","created_at":"2026-09-14T08:37:02.538Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53c44ec6027b1f604cec470ac6c926d2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.541Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-7ac1ac3d3a740e898166aa54: done: 0.059071 sec","job_status":"done","queue_duration_s":0.611591,"scheduling_latency_s":0.611633,"redis_calls":7,"redis_duration_s":0.010925,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003186,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059071,"completed_at":"2026-09-14T08:37:03.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001549,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 168.932337] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.220Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8baaae596edb3fafa62b0fd2","created_at":"2026-09-14T08:37:02.569Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74910ae9fde8c39d185c3c9fd26b5e20","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.572Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8baaae596edb3fafa62b0fd2: start","job_status":"start","queue_duration_s":0.648538,"scheduling_latency_s":0.648574}1485gitlab # [ 169.020857] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8baaae596edb3fafa62b0fd2","created_at":"2026-09-14T08:37:02.569Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74910ae9fde8c39d185c3c9fd26b5e20","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.572Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8baaae596edb3fafa62b0fd2: done: 0.109634 sec","job_status":"done","queue_duration_s":0.648538,"scheduling_latency_s":0.648574,"redis_calls":9,"redis_duration_s":0.040574,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.035311,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001080025,"exclusive_lock_hold_duration_s":0.025093133,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.109634,"completed_at":"2026-09-14T08:37:03.330Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 169.048336] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"433f5e9a533797ba8ab590ea","created_at":"2026-09-14T08:37:02.589Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"583cfcaef71983469495a1c0794dccc0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T08:37:02.592Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-433f5e9a533797ba8ab590ea: start","job_status":"start","queue_duration_s":0.747376,"scheduling_latency_s":0.747436}1487gitlab # [ 169.115372] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.425Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"433f5e9a533797ba8ab590ea","created_at":"2026-09-14T08:37:02.589Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"583cfcaef71983469495a1c0794dccc0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T08:37:02.592Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-433f5e9a533797ba8ab590ea: done: 0.085558 sec","job_status":"done","queue_duration_s":0.747376,"scheduling_latency_s":0.747436,"redis_calls":7,"redis_duration_s":0.038353,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.033682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004671,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.085558,"completed_at":"2026-09-14T08:37:03.425Z","load_balancing_strategy":"primary","db_duration_s":0.002733,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 169.156337] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.466Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d764de380334b0ad9cf3f406","created_at":"2026-09-14T08:37:02.636Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2d866d17659b86f647929873678453f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.640Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d764de380334b0ad9cf3f406: start","job_status":"start","queue_duration_s":0.826062,"scheduling_latency_s":0.826107}1489gitlab # [ 169.218470] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.528Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d764de380334b0ad9cf3f406","created_at":"2026-09-14T08:37:02.636Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2d866d17659b86f647929873678453f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.640Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d764de380334b0ad9cf3f406: done: 0.062513 sec","job_status":"done","queue_duration_s":0.826062,"scheduling_latency_s":0.826107,"redis_calls":9,"redis_duration_s":0.005679,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003484,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000944254,"exclusive_lock_hold_duration_s":0.027346493,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.062513,"completed_at":"2026-09-14T08:37:03.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024826,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 169.260291] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ffaa1aadea70fb4c3542d01b","created_at":"2026-09-14T08:37:02.684Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"301b9defc9eded123325be4c574f2140","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.689Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ffaa1aadea70fb4c3542d01b: start","job_status":"start","queue_duration_s":0.880563,"scheduling_latency_s":0.880595}1491gitlab # [ 169.288077] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.598Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1492gitlab # [ 169.309618] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.619Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ffaa1aadea70fb4c3542d01b","created_at":"2026-09-14T08:37:02.684Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"301b9defc9eded123325be4c574f2140","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.689Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ffaa1aadea70fb4c3542d01b: done: 0.049047 sec","job_status":"done","queue_duration_s":0.880563,"scheduling_latency_s":0.880595,"redis_calls":7,"redis_duration_s":0.009308,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006024,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049047,"completed_at":"2026-09-14T08:37:03.619Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 169.351959] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c46935a4cfbab352f9396968","created_at":"2026-09-14T08:37:02.698Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a5829989c43acccb8bbc2db245214d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.700Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c46935a4cfbab352f9396968: start","job_status":"start","queue_duration_s":0.961678,"scheduling_latency_s":0.961725}1494gitlab # [ 169.683084] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c46935a4cfbab352f9396968","created_at":"2026-09-14T08:37:02.698Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a5829989c43acccb8bbc2db245214d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.700Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c46935a4cfbab352f9396968: done: 0.331345 sec","job_status":"done","queue_duration_s":0.961678,"scheduling_latency_s":0.961725,"redis_calls":9,"redis_duration_s":0.009854,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004877,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.076,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.076,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.141803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002469029,"exclusive_lock_hold_duration_s":0.269064923,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.331345,"completed_at":"2026-09-14T08:37:03.993Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.170095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 169.720679] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:03.997Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"216a9acd611b375152aae2b1","created_at":"2026-09-14T08:37:02.792Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b43a0a9ad22cca3f9f7ace22f83eb27","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.798Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-216a9acd611b375152aae2b1: start","job_status":"start","queue_duration_s":1.19892,"scheduling_latency_s":1.198937}1496gitlab # [ 169.734029] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.007Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1497gitlab # [ 169.737566] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"216a9acd611b375152aae2b1","created_at":"2026-09-14T08:37:02.792Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b43a0a9ad22cca3f9f7ace22f83eb27","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.798Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-216a9acd611b375152aae2b1: done: 0.019651 sec","job_status":"done","queue_duration_s":1.19892,"scheduling_latency_s":1.198937,"redis_calls":7,"redis_duration_s":0.004979,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001054,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019651,"completed_at":"2026-09-14T08:37:04.016Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 169.773803] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"09adcb3de1e06a2136b84dbb","created_at":"2026-09-14T08:37:02.805Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"088ba10953ce009c6b5a651da27fd684","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.810Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-09adcb3de1e06a2136b84dbb: start","job_status":"start","queue_duration_s":1.214555,"scheduling_latency_s":1.214574}1499gitlab # [ 169.786170] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"09adcb3de1e06a2136b84dbb","created_at":"2026-09-14T08:37:02.805Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"088ba10953ce009c6b5a651da27fd684","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.810Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-09adcb3de1e06a2136b84dbb: done: 0.029279 sec","job_status":"done","queue_duration_s":1.214555,"scheduling_latency_s":1.214574,"redis_calls":9,"redis_duration_s":0.007553000000000001,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003769,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003784,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001199314,"exclusive_lock_hold_duration_s":0.009259557,"duration_s":0.029279,"completed_at":"2026-09-14T08:37:04.054Z","load_balancing_strategy":"primary","db_duration_s":0.007437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 169.821806] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.057Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f4c9368956db10ed9d6ac2e0","created_at":"2026-09-14T08:37:02.851Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"984db4b42ccff3a69fab757edf384cbd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.860Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f4c9368956db10ed9d6ac2e0: start","job_status":"start","queue_duration_s":1.196594,"scheduling_latency_s":1.196611}1501gitlab # [ 169.835029] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.107Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f4c9368956db10ed9d6ac2e0","created_at":"2026-09-14T08:37:02.851Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"984db4b42ccff3a69fab757edf384cbd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.860Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f4c9368956db10ed9d6ac2e0: done: 0.049866 sec","job_status":"done","queue_duration_s":1.196594,"scheduling_latency_s":1.196611,"redis_calls":10,"redis_duration_s":0.006116999999999999,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00435,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001767,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.018716625,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.049866,"completed_at":"2026-09-14T08:37:04.107Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02743,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1502gitlab # [ 169.835787] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7c014bb0a20e1c1708d3d5d9","created_at":"2026-09-14T08:37:02.886Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d75554298784c187ea0e9a93a85dae8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.897Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7c014bb0a20e1c1708d3d5d9: start","job_status":"start","queue_duration_s":1.212589,"scheduling_latency_s":1.212605}1503gitlab # [ 169.876172] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7c014bb0a20e1c1708d3d5d9","created_at":"2026-09-14T08:37:02.886Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d75554298784c187ea0e9a93a85dae8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.897Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7c014bb0a20e1c1708d3d5d9: done: 0.020708 sec","job_status":"done","queue_duration_s":1.212589,"scheduling_latency_s":1.212605,"redis_calls":7,"redis_duration_s":0.007557,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00606,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020708,"completed_at":"2026-09-14T08:37:04.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 169.883761] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"eb1b2e919aba2e9dfcaa64f4","created_at":"2026-09-14T08:37:02.913Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65f947bbd0b7e630fe3a4de28669b74b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.921Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-eb1b2e919aba2e9dfcaa64f4: start","job_status":"start","queue_duration_s":1.211827,"scheduling_latency_s":1.21184}1505gitlab # [ 170.438171] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.747Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"eb1b2e919aba2e9dfcaa64f4","created_at":"2026-09-14T08:37:02.913Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65f947bbd0b7e630fe3a4de28669b74b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.921Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-eb1b2e919aba2e9dfcaa64f4: done: 0.614597 sec","job_status":"done","queue_duration_s":1.211827,"scheduling_latency_s":1.21184,"redis_calls":562,"redis_duration_s":0.42966899999999997,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.42638,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.614597,"completed_at":"2026-09-14T08:37:04.747Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 170.479278] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bf96908af8873d3d48d577a7","created_at":"2026-09-14T08:37:02.936Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ab4bf6f822cd1d107d28be3e22fdf39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.942Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bf96908af8873d3d48d577a7: start","job_status":"start","queue_duration_s":1.847245,"scheduling_latency_s":1.847288}1507gitlab # [ 170.519669] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.829Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1508gitlab # [ 170.546672] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bf96908af8873d3d48d577a7","created_at":"2026-09-14T08:37:02.936Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ab4bf6f822cd1d107d28be3e22fdf39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.942Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bf96908af8873d3d48d577a7: done: 0.067219 sec","job_status":"done","queue_duration_s":1.847245,"scheduling_latency_s":1.847288,"redis_calls":7,"redis_duration_s":0.007847,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001513,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067219,"completed_at":"2026-09-14T08:37:04.856Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 170.590402] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:04.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5baafc211ec2a42f0b3ccdcd","created_at":"2026-09-14T08:37:02.966Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"872b89e4eb45eceba3e729e57ba52095","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.970Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5baafc211ec2a42f0b3ccdcd: start","job_status":"start","queue_duration_s":1.929578,"scheduling_latency_s":1.929624}1510gitlab # [ 170.696211] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5baafc211ec2a42f0b3ccdcd","created_at":"2026-09-14T08:37:02.966Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"872b89e4eb45eceba3e729e57ba52095","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:02.970Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5baafc211ec2a42f0b3ccdcd: done: 0.105377 sec","job_status":"done","queue_duration_s":1.929578,"scheduling_latency_s":1.929624,"redis_calls":9,"redis_duration_s":0.014645000000000002,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009442,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005203,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001357435,"exclusive_lock_hold_duration_s":0.047946876,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.105377,"completed_at":"2026-09-14T08:37:05.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032896,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 170.764571] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"19f1484c93dfea59ab5306eb","created_at":"2026-09-14T08:37:02.986Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ba3a630273eec344c874eed2932be3e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T08:37:02.992Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-19f1484c93dfea59ab5306eb: start","job_status":"start","queue_duration_s":2.082506,"scheduling_latency_s":2.082554}1512gitlab # [ 170.791285] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.101Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1513gitlab # [ 170.810331] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"19f1484c93dfea59ab5306eb","created_at":"2026-09-14T08:37:02.986Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ba3a630273eec344c874eed2932be3e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T08:37:02.992Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-19f1484c93dfea59ab5306eb: done: 0.045903 sec","job_status":"done","queue_duration_s":2.082506,"scheduling_latency_s":2.082554,"redis_calls":7,"redis_duration_s":0.011075999999999999,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003341,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045903,"completed_at":"2026-09-14T08:37:05.120Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 170.831838] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.127Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"5f858b0b098018f13c2c1180","created_at":"2026-09-14T08:37:03.005Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6ae226994c5bfb9e18ba1e7cb9e7255","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.018Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-5f858b0b098018f13c2c1180: start","job_status":"start","queue_duration_s":2.108624,"scheduling_latency_s":2.108664}1515gitlab # [ 170.896536] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.206Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"5f858b0b098018f13c2c1180","created_at":"2026-09-14T08:37:03.005Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6ae226994c5bfb9e18ba1e7cb9e7255","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.018Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-5f858b0b098018f13c2c1180: done: 0.079222 sec","job_status":"done","queue_duration_s":2.108624,"scheduling_latency_s":2.108664,"redis_calls":7,"redis_duration_s":0.032334,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.025871,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079222,"completed_at":"2026-09-14T08:37:05.206Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008887,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 170.905709] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.215Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"494636159ff0f9aaf3139751","created_at":"2026-09-14T08:37:02.996Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-22a2b1ec10544634","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1c7f5f13c25caa015469f8148f947f4a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.036Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-494636159ff0f9aaf3139751: start","job_status":"start","queue_duration_s":2.179191,"scheduling_latency_s":2.179233}1517gitlab # [ 170.947564] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.257Z","message":"No existing merge request to be cleaned up."}1518gitlab # [ 170.969117] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.278Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"494636159ff0f9aaf3139751","created_at":"2026-09-14T08:37:02.996Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-22a2b1ec10544634","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1c7f5f13c25caa015469f8148f947f4a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.036Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-494636159ff0f9aaf3139751: done: 0.063181 sec","job_status":"done","queue_duration_s":2.179191,"scheduling_latency_s":2.179233,"redis_calls":10,"redis_duration_s":0.014780000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.009197,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063181,"completed_at":"2026-09-14T08:37:05.278Z","load_balancing_strategy":"primary","db_duration_s":0.013914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 171.011475] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.321Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1fac9af5dc6c40fd14bd48b2","created_at":"2026-09-14T08:37:02.996Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-22a2b1ec10544634","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1c7f5f13c25caa015469f8148f947f4a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.036Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1fac9af5dc6c40fd14bd48b2: start","job_status":"start","queue_duration_s":2.285478,"scheduling_latency_s":2.285516}1520gitlab # [ 171.086720] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.397Z","message":"No existing merge request to be cleaned up."}1521gitlab # [ 171.116959] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.426Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1fac9af5dc6c40fd14bd48b2","created_at":"2026-09-14T08:37:02.996Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-22a2b1ec10544634","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1c7f5f13c25caa015469f8148f947f4a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.036Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1fac9af5dc6c40fd14bd48b2: done: 0.104824 sec","job_status":"done","queue_duration_s":2.285478,"scheduling_latency_s":2.285516,"redis_calls":10,"redis_duration_s":0.017091,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.010199,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.104824,"completed_at":"2026-09-14T08:37:05.426Z","load_balancing_strategy":"primary","db_duration_s":0.008054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 171.184338] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.494Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3bf24d79308c0ae30068ac7e","created_at":"2026-09-14T08:37:02.996Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-22a2b1ec10544634","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1c7f5f13c25caa015469f8148f947f4a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.036Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3bf24d79308c0ae30068ac7e: start","job_status":"start","queue_duration_s":2.458051,"scheduling_latency_s":2.458101}1523gitlab # [ 171.240301] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.550Z","message":"No existing merge request to be cleaned up."}1524gitlab # [ 171.294934] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.604Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3bf24d79308c0ae30068ac7e","created_at":"2026-09-14T08:37:02.996Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-22a2b1ec10544634","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1c7f5f13c25caa015469f8148f947f4a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.036Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3bf24d79308c0ae30068ac7e: done: 0.109953 sec","job_status":"done","queue_duration_s":2.458051,"scheduling_latency_s":2.458101,"redis_calls":10,"redis_duration_s":0.011403,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00745,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.022,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.022,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.109953,"completed_at":"2026-09-14T08:37:05.604Z","load_balancing_strategy":"primary","db_duration_s":0.032276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 171.359737] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.610Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7aecac5454a2a55add6f12d7","created_at":"2026-09-14T08:37:02.996Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-22a2b1ec10544634","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1c7f5f13c25caa015469f8148f947f4a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.036Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7aecac5454a2a55add6f12d7: start","job_status":"start","queue_duration_s":2.574165,"scheduling_latency_s":2.574206}1526gitlab # [ 171.370726] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.635Z","message":"No existing merge request to be cleaned up."}1527gitlab # [ 171.372368] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.656Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7aecac5454a2a55add6f12d7","created_at":"2026-09-14T08:37:02.996Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-22a2b1ec10544634","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1c7f5f13c25caa015469f8148f947f4a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.036Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7aecac5454a2a55add6f12d7: done: 0.046205 sec","job_status":"done","queue_duration_s":2.574165,"scheduling_latency_s":2.574206,"redis_calls":10,"redis_duration_s":0.015601,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.008059,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046205,"completed_at":"2026-09-14T08:37:05.656Z","load_balancing_strategy":"primary","db_duration_s":0.005481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 171.406375] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"3a0024003da71b03528e2e69","created_at":"2026-09-14T08:37:03.035Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"722740860d378610dcb7b3c039ab3271","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.044Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-3a0024003da71b03528e2e69: start","job_status":"start","queue_duration_s":2.616091,"scheduling_latency_s":2.616109}1529gitlab # [ 171.419283] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.676Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1530gitlab # [ 171.422320] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"3a0024003da71b03528e2e69","created_at":"2026-09-14T08:37:03.035Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"722740860d378610dcb7b3c039ab3271","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.044Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-3a0024003da71b03528e2e69: done: 0.028649 sec","job_status":"done","queue_duration_s":2.616091,"scheduling_latency_s":2.616109,"redis_calls":7,"redis_duration_s":0.006354,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00208,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028649,"completed_at":"2026-09-14T08:37:05.689Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 171.442911] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.694Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5ca7ee8f5f96c6e490311998","created_at":"2026-09-14T08:37:03.062Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.068Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5ca7ee8f5f96c6e490311998: start","job_status":"start","queue_duration_s":2.625696,"scheduling_latency_s":2.625712}1532gitlab # [ 171.474766] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.785Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5ca7ee8f5f96c6e490311998","created_at":"2026-09-14T08:37:03.062Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-6fd636e74a624a28","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:03.068Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5ca7ee8f5f96c6e490311998: done: 0.091009 sec","job_status":"done","queue_duration_s":2.625696,"scheduling_latency_s":2.625712,"redis_calls":60,"redis_duration_s":0.017439,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.00048,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.014775,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002184,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.091009,"completed_at":"2026-09-14T08:37:05.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 171.495137] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5b0b54fc552b525857ea393","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5b0b54fc552b525857ea393: start","job_status":"start","queue_duration_s":0.012444,"scheduling_latency_s":0.012465}1534gitlab # [ 171.535034] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5b0b54fc552b525857ea393","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5b0b54fc552b525857ea393: done: 0.054676 sec","job_status":"done","queue_duration_s":0.012444,"scheduling_latency_s":0.012465,"redis_calls":13,"redis_duration_s":0.035865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003225,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.03264,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.054676,"completed_at":"2026-09-14T08:37:05.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 171.576305] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e0fcc0ebc8c4a4d65cbd0aa","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e0fcc0ebc8c4a4d65cbd0aa: start","job_status":"start","queue_duration_s":0.107931,"scheduling_latency_s":0.107977}1536gitlab # [ 171.642207] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:05.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e0fcc0ebc8c4a4d65cbd0aa","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e0fcc0ebc8c4a4d65cbd0aa: done: 0.065907 sec","job_status":"done","queue_duration_s":0.107931,"scheduling_latency_s":0.107977,"redis_calls":13,"redis_duration_s":0.020147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005628,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.014519,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.065907,"completed_at":"2026-09-14T08:37:05.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 171.691396] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43bb5fd4a4dfeaa777949d2d","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43bb5fd4a4dfeaa777949d2d: start","job_status":"start","queue_duration_s":0.223125,"scheduling_latency_s":0.223175}1538gitlab # [ 171.744169] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43bb5fd4a4dfeaa777949d2d","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43bb5fd4a4dfeaa777949d2d: done: 0.052694 sec","job_status":"done","queue_duration_s":0.223125,"scheduling_latency_s":0.223175,"redis_calls":13,"redis_duration_s":0.016762,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.052694,"completed_at":"2026-09-14T08:37:06.053Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 171.786502] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c8e7299f0bc638e662e5bcd","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c8e7299f0bc638e662e5bcd: start","job_status":"start","queue_duration_s":0.318126,"scheduling_latency_s":0.318168}1540gitlab # [ 171.833931] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c8e7299f0bc638e662e5bcd","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c8e7299f0bc638e662e5bcd: done: 0.047644 sec","job_status":"done","queue_duration_s":0.318126,"scheduling_latency_s":0.318168,"redis_calls":13,"redis_duration_s":0.018881000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.01302,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.047644,"completed_at":"2026-09-14T08:37:06.143Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 171.877191] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df27bab9f816b5cb16e96bac","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df27bab9f816b5cb16e96bac: start","job_status":"start","queue_duration_s":0.409123,"scheduling_latency_s":0.409155}1542gitlab # [ 171.937879] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df27bab9f816b5cb16e96bac","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df27bab9f816b5cb16e96bac: done: 0.060367 sec","job_status":"done","queue_duration_s":0.409123,"scheduling_latency_s":0.409155,"redis_calls":13,"redis_duration_s":0.016002000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060367,"completed_at":"2026-09-14T08:37:06.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 171.958790] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79db544ec92fcffadbb24e2a","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79db544ec92fcffadbb24e2a: start","job_status":"start","queue_duration_s":0.480839,"scheduling_latency_s":0.480882}1544gitlab # [ 172.018889] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79db544ec92fcffadbb24e2a","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79db544ec92fcffadbb24e2a: done: 0.069633 sec","job_status":"done","queue_duration_s":0.480839,"scheduling_latency_s":0.480882,"redis_calls":13,"redis_duration_s":0.03987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00415,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.03572,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.069633,"completed_at":"2026-09-14T08:37:06.328Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 172.057266] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4868733600635e13317e9782","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4868733600635e13317e9782: start","job_status":"start","queue_duration_s":0.588849,"scheduling_latency_s":0.588898}1546gitlab # [ 172.083410] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4868733600635e13317e9782","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4868733600635e13317e9782: done: 0.026329 sec","job_status":"done","queue_duration_s":0.588849,"scheduling_latency_s":0.588898,"redis_calls":13,"redis_duration_s":0.003874,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002487,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026329,"completed_at":"2026-09-14T08:37:06.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 172.120971] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bbc3d92a6b3c40e065800df","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bbc3d92a6b3c40e065800df: start","job_status":"start","queue_duration_s":0.652675,"scheduling_latency_s":0.652727}1548gitlab # [ 172.147804] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bbc3d92a6b3c40e065800df","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bbc3d92a6b3c40e065800df: done: 0.026936 sec","job_status":"done","queue_duration_s":0.652675,"scheduling_latency_s":0.652727,"redis_calls":13,"redis_duration_s":0.004018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001249,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026936,"completed_at":"2026-09-14T08:37:06.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 172.149961] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d840dd8ffd82b1e0c21a846","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d840dd8ffd82b1e0c21a846: start","job_status":"start","queue_duration_s":0.681919,"scheduling_latency_s":0.681951}1550gitlab # [ 172.204958] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d840dd8ffd82b1e0c21a846","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d840dd8ffd82b1e0c21a846: done: 0.053524 sec","job_status":"done","queue_duration_s":0.681919,"scheduling_latency_s":0.681951,"redis_calls":13,"redis_duration_s":0.034583,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.033529,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.053524,"completed_at":"2026-09-14T08:37:06.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 172.241856] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83f6c84a7e0c52f9de620c34","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83f6c84a7e0c52f9de620c34: start","job_status":"start","queue_duration_s":0.773559,"scheduling_latency_s":0.773605}1552gitlab # [ 172.269753] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83f6c84a7e0c52f9de620c34","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83f6c84a7e0c52f9de620c34: done: 0.027639 sec","job_status":"done","queue_duration_s":0.773559,"scheduling_latency_s":0.773605,"redis_calls":13,"redis_duration_s":0.002055,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001257,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027639,"completed_at":"2026-09-14T08:37:06.579Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 172.306672] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"280dc6e7edcfc4de0c0dedf0","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-280dc6e7edcfc4de0c0dedf0: start","job_status":"start","queue_duration_s":0.838462,"scheduling_latency_s":0.838518}1554gitlab # [ 172.332710] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"280dc6e7edcfc4de0c0dedf0","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-280dc6e7edcfc4de0c0dedf0: done: 0.025919 sec","job_status":"done","queue_duration_s":0.838462,"scheduling_latency_s":0.838518,"redis_calls":13,"redis_duration_s":0.00413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001329,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002801,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025919,"completed_at":"2026-09-14T08:37:06.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 172.370130] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73aba0350b74145b9c3bc692","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73aba0350b74145b9c3bc692: start","job_status":"start","queue_duration_s":0.901861,"scheduling_latency_s":0.901904}1556gitlab # [ 172.396859] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73aba0350b74145b9c3bc692","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73aba0350b74145b9c3bc692: done: 0.026773 sec","job_status":"done","queue_duration_s":0.901861,"scheduling_latency_s":0.901904,"redis_calls":13,"redis_duration_s":0.003904,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001225,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002679,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026773,"completed_at":"2026-09-14T08:37:06.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 172.398765] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1c8749bf4ee764f92b49666","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1c8749bf4ee764f92b49666: start","job_status":"start","queue_duration_s":0.930793,"scheduling_latency_s":0.93082}1558gitlab # [ 172.415118] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1c8749bf4ee764f92b49666","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1c8749bf4ee764f92b49666: done: 0.015917 sec","job_status":"done","queue_duration_s":0.930793,"scheduling_latency_s":0.93082,"redis_calls":13,"redis_duration_s":0.002956,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015917,"completed_at":"2026-09-14T08:37:06.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 172.467289] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5ee67bd8c1cdfb07698f1f7","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5ee67bd8c1cdfb07698f1f7: start","job_status":"start","queue_duration_s":0.948015,"scheduling_latency_s":0.948028}1560gitlab # [ 172.467827] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5ee67bd8c1cdfb07698f1f7","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5ee67bd8c1cdfb07698f1f7: done: 0.009584 sec","job_status":"done","queue_duration_s":0.948015,"scheduling_latency_s":0.948028,"redis_calls":13,"redis_duration_s":0.001557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009584,"completed_at":"2026-09-14T08:37:06.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 172.509170] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"554d803310df2b2df93f096b","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-554d803310df2b2df93f096b: start","job_status":"start","queue_duration_s":0.958375,"scheduling_latency_s":0.958411}1562gitlab # [ 172.509978] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"554d803310df2b2df93f096b","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-554d803310df2b2df93f096b: done: 0.010451 sec","job_status":"done","queue_duration_s":0.958375,"scheduling_latency_s":0.958411,"redis_calls":13,"redis_duration_s":0.002538,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001671,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010451,"completed_at":"2026-09-14T08:37:06.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 172.530772] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"664d786d24f9c0e4b40bdc74","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-664d786d24f9c0e4b40bdc74: start","job_status":"start","queue_duration_s":0.969902,"scheduling_latency_s":0.969915}1564gitlab # [ 172.573372] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"664d786d24f9c0e4b40bdc74","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-664d786d24f9c0e4b40bdc74: done: 0.01045 sec","job_status":"done","queue_duration_s":0.969902,"scheduling_latency_s":0.969915,"redis_calls":13,"redis_duration_s":0.002515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001712,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01045,"completed_at":"2026-09-14T08:37:06.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 172.576760] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8067f5b7ac338827eb892b58","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8067f5b7ac338827eb892b58: start","job_status":"start","queue_duration_s":0.98142,"scheduling_latency_s":0.981434}1566gitlab # [ 172.588871] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8067f5b7ac338827eb892b58","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8067f5b7ac338827eb892b58: done: 0.010006 sec","job_status":"done","queue_duration_s":0.98142,"scheduling_latency_s":0.981434,"redis_calls":13,"redis_duration_s":0.002119,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001406,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010006,"completed_at":"2026-09-14T08:37:06.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 172.625481] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8efd1a71a19cb0efb589320f","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8efd1a71a19cb0efb589320f: start","job_status":"start","queue_duration_s":0.992945,"scheduling_latency_s":0.992958}1568gitlab # [ 172.636650] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8efd1a71a19cb0efb589320f","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8efd1a71a19cb0efb589320f: done: 0.027452 sec","job_status":"done","queue_duration_s":0.992945,"scheduling_latency_s":0.992958,"redis_calls":13,"redis_duration_s":0.018905,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.018054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027452,"completed_at":"2026-09-14T08:37:06.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 172.683739] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0db93ffbd5836f78456b005","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0db93ffbd5836f78456b005: start","job_status":"start","queue_duration_s":1.021566,"scheduling_latency_s":1.02158}1570gitlab # [ 172.684587] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0db93ffbd5836f78456b005","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0db93ffbd5836f78456b005: done: 0.010402 sec","job_status":"done","queue_duration_s":1.021566,"scheduling_latency_s":1.02158,"redis_calls":13,"redis_duration_s":0.00251,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001697,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010402,"completed_at":"2026-09-14T08:37:06.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 172.724955] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffd3b1bbb5772ce0055af571","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffd3b1bbb5772ce0055af571: start","job_status":"start","queue_duration_s":1.033032,"scheduling_latency_s":1.033045}1572gitlab # [ 172.729270] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffd3b1bbb5772ce0055af571","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffd3b1bbb5772ce0055af571: done: 0.010071 sec","job_status":"done","queue_duration_s":1.033032,"scheduling_latency_s":1.033045,"redis_calls":13,"redis_duration_s":0.0023810000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001716,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010071,"completed_at":"2026-09-14T08:37:06.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 172.772833] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c576e74ad1d621dce55654d8","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c576e74ad1d621dce55654d8: start","job_status":"start","queue_duration_s":1.043967,"scheduling_latency_s":1.04398}1574gitlab # [ 172.776472] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c576e74ad1d621dce55654d8","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c576e74ad1d621dce55654d8: done: 0.009407 sec","job_status":"done","queue_duration_s":1.043967,"scheduling_latency_s":1.04398,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009407,"completed_at":"2026-09-14T08:37:06.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 172.847925] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99581c755647b3d1ae36291c","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99581c755647b3d1ae36291c: start","job_status":"start","queue_duration_s":1.054191,"scheduling_latency_s":1.054204}1576gitlab # [ 172.848877] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99581c755647b3d1ae36291c","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99581c755647b3d1ae36291c: done: 0.009068 sec","job_status":"done","queue_duration_s":1.054191,"scheduling_latency_s":1.054204,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009068,"completed_at":"2026-09-14T08:37:06.841Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 172.861003] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6619155d77712d7874ae3964","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6619155d77712d7874ae3964: start","job_status":"start","queue_duration_s":1.064097,"scheduling_latency_s":1.064111}1578gitlab # [ 172.906229] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6619155d77712d7874ae3964","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6619155d77712d7874ae3964: done: 0.009098 sec","job_status":"done","queue_duration_s":1.064097,"scheduling_latency_s":1.064111,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009098,"completed_at":"2026-09-14T08:37:06.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 172.907876] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19838f300d76880cf64eb316","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19838f300d76880cf64eb316: start","job_status":"start","queue_duration_s":1.074022,"scheduling_latency_s":1.074034}1580gitlab # [ 172.949133] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19838f300d76880cf64eb316","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19838f300d76880cf64eb316: done: 0.009286 sec","job_status":"done","queue_duration_s":1.074022,"scheduling_latency_s":1.074034,"redis_calls":13,"redis_duration_s":0.0014789999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009286,"completed_at":"2026-09-14T08:37:06.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 172.954778] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c6bc27d744a786677e47d16","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c6bc27d744a786677e47d16: start","job_status":"start","queue_duration_s":1.084115,"scheduling_latency_s":1.084128}1582gitlab # [ 172.966601] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c6bc27d744a786677e47d16","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c6bc27d744a786677e47d16: done: 0.009105 sec","job_status":"done","queue_duration_s":1.084115,"scheduling_latency_s":1.084128,"redis_calls":13,"redis_duration_s":0.001489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009105,"completed_at":"2026-09-14T08:37:06.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 173.028242] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1fef1fd83a56a32da09fceb2","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1fef1fd83a56a32da09fceb2: start","job_status":"start","queue_duration_s":1.094051,"scheduling_latency_s":1.094071}1584gitlab # [ 173.029079] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1fef1fd83a56a32da09fceb2","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1fef1fd83a56a32da09fceb2: done: 0.009403 sec","job_status":"done","queue_duration_s":1.094051,"scheduling_latency_s":1.094071,"redis_calls":13,"redis_duration_s":0.0017139999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009403,"completed_at":"2026-09-14T08:37:06.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 173.068383] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5af8b1242770b12b4ccb159","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5af8b1242770b12b4ccb159: start","job_status":"start","queue_duration_s":1.104254,"scheduling_latency_s":1.104267}1586gitlab # [ 173.069276] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5af8b1242770b12b4ccb159","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5af8b1242770b12b4ccb159: done: 0.009037 sec","job_status":"done","queue_duration_s":1.104254,"scheduling_latency_s":1.104267,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009037,"completed_at":"2026-09-14T08:37:06.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 173.108727] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0efe07d03257e08ee38abbbd","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0efe07d03257e08ee38abbbd: start","job_status":"start","queue_duration_s":1.114327,"scheduling_latency_s":1.11434}1588gitlab # [ 173.109849] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0efe07d03257e08ee38abbbd","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0efe07d03257e08ee38abbbd: done: 0.009023 sec","job_status":"done","queue_duration_s":1.114327,"scheduling_latency_s":1.11434,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009023,"completed_at":"2026-09-14T08:37:06.901Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 173.158895] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a0572fa3d3110730ed2dec5","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a0572fa3d3110730ed2dec5: start","job_status":"start","queue_duration_s":1.124165,"scheduling_latency_s":1.124177}1590gitlab # [ 173.160140] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a0572fa3d3110730ed2dec5","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a0572fa3d3110730ed2dec5: done: 0.009116 sec","job_status":"done","queue_duration_s":1.124165,"scheduling_latency_s":1.124177,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009116,"completed_at":"2026-09-14T08:37:06.911Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 173.200924] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ba265160df34d3e52072b3a","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ba265160df34d3e52072b3a: start","job_status":"start","queue_duration_s":1.134104,"scheduling_latency_s":1.134117}1592gitlab # [ 173.201978] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ba265160df34d3e52072b3a","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ba265160df34d3e52072b3a: done: 0.009057 sec","job_status":"done","queue_duration_s":1.134104,"scheduling_latency_s":1.134117,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009057,"completed_at":"2026-09-14T08:37:06.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 173.258763] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4356362d4f2152d22bbbd2c0","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4356362d4f2152d22bbbd2c0: start","job_status":"start","queue_duration_s":1.143992,"scheduling_latency_s":1.144006}1594gitlab # [ 173.259779] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4356362d4f2152d22bbbd2c0","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4356362d4f2152d22bbbd2c0: done: 0.00925 sec","job_status":"done","queue_duration_s":1.143992,"scheduling_latency_s":1.144006,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00925,"completed_at":"2026-09-14T08:37:06.931Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 173.301335] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f21f2560df49b6d572999b9b","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f21f2560df49b6d572999b9b: start","job_status":"start","queue_duration_s":1.154225,"scheduling_latency_s":1.154237}1596gitlab # [ 173.302180] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f21f2560df49b6d572999b9b","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f21f2560df49b6d572999b9b: done: 0.008839 sec","job_status":"done","queue_duration_s":1.154225,"scheduling_latency_s":1.154237,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008839,"completed_at":"2026-09-14T08:37:06.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 173.346404] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1aa1fea7c4366ec728bb20","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1aa1fea7c4366ec728bb20: start","job_status":"start","queue_duration_s":1.163871,"scheduling_latency_s":1.163884}1598gitlab # [ 173.347575] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1aa1fea7c4366ec728bb20","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1aa1fea7c4366ec728bb20: done: 0.008773 sec","job_status":"done","queue_duration_s":1.163871,"scheduling_latency_s":1.163884,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008773,"completed_at":"2026-09-14T08:37:06.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 173.394880] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32c6aff1ab2779d80635495d","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32c6aff1ab2779d80635495d: start","job_status":"start","queue_duration_s":1.173439,"scheduling_latency_s":1.173452}1600gitlab # [ 173.395963] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32c6aff1ab2779d80635495d","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32c6aff1ab2779d80635495d: done: 0.008855 sec","job_status":"done","queue_duration_s":1.173439,"scheduling_latency_s":1.173452,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008855,"completed_at":"2026-09-14T08:37:06.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 173.435411] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daceea6157393b40baa81300","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daceea6157393b40baa81300: start","job_status":"start","queue_duration_s":1.183097,"scheduling_latency_s":1.183109}1602gitlab # [ 173.436354] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daceea6157393b40baa81300","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daceea6157393b40baa81300: done: 0.008816 sec","job_status":"done","queue_duration_s":1.183097,"scheduling_latency_s":1.183109,"redis_calls":13,"redis_duration_s":0.001419,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008816,"completed_at":"2026-09-14T08:37:06.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 173.489088] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c7c157ceac67209a1e8225e","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c7c157ceac67209a1e8225e: start","job_status":"start","queue_duration_s":1.192838,"scheduling_latency_s":1.19285}1604gitlab # [ 173.489904] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c7c157ceac67209a1e8225e","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c7c157ceac67209a1e8225e: done: 0.008974 sec","job_status":"done","queue_duration_s":1.192838,"scheduling_latency_s":1.19285,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008974,"completed_at":"2026-09-14T08:37:06.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 173.507089] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93a2d1a26070d2fe91d4592a","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93a2d1a26070d2fe91d4592a: start","job_status":"start","queue_duration_s":1.202611,"scheduling_latency_s":1.202624}1606gitlab # [ 173.550807] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93a2d1a26070d2fe91d4592a","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93a2d1a26070d2fe91d4592a: done: 0.008848 sec","job_status":"done","queue_duration_s":1.202611,"scheduling_latency_s":1.202624,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008848,"completed_at":"2026-09-14T08:37:06.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 173.553823] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a427c7aad55d26e17d9d719d","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a427c7aad55d26e17d9d719d: start","job_status":"start","queue_duration_s":1.212246,"scheduling_latency_s":1.212259}1608gitlab # [ 173.565900] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:06.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a427c7aad55d26e17d9d719d","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a427c7aad55d26e17d9d719d: done: 0.009455 sec","job_status":"done","queue_duration_s":1.212246,"scheduling_latency_s":1.212259,"redis_calls":13,"redis_duration_s":0.001784,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001286,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009455,"completed_at":"2026-09-14T08:37:06.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 173.617731] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fc86e2bf42c91360dc39526","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fc86e2bf42c91360dc39526: start","job_status":"start","queue_duration_s":1.222759,"scheduling_latency_s":1.222773}1610gitlab # [ 173.618694] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fc86e2bf42c91360dc39526","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fc86e2bf42c91360dc39526: done: 0.008876 sec","job_status":"done","queue_duration_s":1.222759,"scheduling_latency_s":1.222773,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008876,"completed_at":"2026-09-14T08:37:07.009Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 173.670123] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5f241c8f20e9c2d774f0cc5","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5f241c8f20e9c2d774f0cc5: start","job_status":"start","queue_duration_s":1.232414,"scheduling_latency_s":1.232426}1612gitlab # [ 173.670918] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5f241c8f20e9c2d774f0cc5","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5f241c8f20e9c2d774f0cc5: done: 0.008949 sec","job_status":"done","queue_duration_s":1.232414,"scheduling_latency_s":1.232426,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008949,"completed_at":"2026-09-14T08:37:07.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 173.729464] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"908e616b4497d2f3c3f8fed2","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-908e616b4497d2f3c3f8fed2: start","job_status":"start","queue_duration_s":1.242138,"scheduling_latency_s":1.242151}1614gitlab # [ 173.730375] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"908e616b4497d2f3c3f8fed2","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-908e616b4497d2f3c3f8fed2: done: 0.009095 sec","job_status":"done","queue_duration_s":1.242138,"scheduling_latency_s":1.242151,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009095,"completed_at":"2026-09-14T08:37:07.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 173.768548] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27f32b2cd1b78abf766507dc","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27f32b2cd1b78abf766507dc: start","job_status":"start","queue_duration_s":1.252044,"scheduling_latency_s":1.252057}1616gitlab # [ 173.769378] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27f32b2cd1b78abf766507dc","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27f32b2cd1b78abf766507dc: done: 0.008684 sec","job_status":"done","queue_duration_s":1.252044,"scheduling_latency_s":1.252057,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008684,"completed_at":"2026-09-14T08:37:07.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 173.816620] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"938f61b1b33eb97ae3ecefcb","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-938f61b1b33eb97ae3ecefcb: start","job_status":"start","queue_duration_s":1.261718,"scheduling_latency_s":1.261731}1618gitlab # [ 173.817542] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"938f61b1b33eb97ae3ecefcb","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-938f61b1b33eb97ae3ecefcb: done: 0.008917 sec","job_status":"done","queue_duration_s":1.261718,"scheduling_latency_s":1.261731,"redis_calls":13,"redis_duration_s":0.001597,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008917,"completed_at":"2026-09-14T08:37:07.048Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 173.831595] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb43dc69e1b4e11b6a517607","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb43dc69e1b4e11b6a517607: start","job_status":"start","queue_duration_s":1.271425,"scheduling_latency_s":1.271438}1620gitlab # [ 173.843105] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb43dc69e1b4e11b6a517607","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb43dc69e1b4e11b6a517607: done: 0.008821 sec","job_status":"done","queue_duration_s":1.271425,"scheduling_latency_s":1.271438,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008821,"completed_at":"2026-09-14T08:37:07.058Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 173.891653] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"880e7085c27a27d28903d7c4","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-880e7085c27a27d28903d7c4: start","job_status":"start","queue_duration_s":1.281008,"scheduling_latency_s":1.28102}1622gitlab # [ 173.892410] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"880e7085c27a27d28903d7c4","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-880e7085c27a27d28903d7c4: done: 0.008819 sec","job_status":"done","queue_duration_s":1.281008,"scheduling_latency_s":1.28102,"redis_calls":13,"redis_duration_s":0.0014579999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008819,"completed_at":"2026-09-14T08:37:07.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 173.923198] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6dfe02b6e585c188ef00a60","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6dfe02b6e585c188ef00a60: start","job_status":"start","queue_duration_s":1.290628,"scheduling_latency_s":1.29064}1624gitlab # [ 173.934212] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6dfe02b6e585c188ef00a60","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6dfe02b6e585c188ef00a60: done: 0.010152 sec","job_status":"done","queue_duration_s":1.290628,"scheduling_latency_s":1.29064,"redis_calls":13,"redis_duration_s":0.002572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010152,"completed_at":"2026-09-14T08:37:07.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 173.978580] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d20f248a4de7e5b50b78c4f","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d20f248a4de7e5b50b78c4f: start","job_status":"start","queue_duration_s":1.302171,"scheduling_latency_s":1.302183}1626gitlab # [ 173.979653] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d20f248a4de7e5b50b78c4f","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d20f248a4de7e5b50b78c4f: done: 0.009064 sec","job_status":"done","queue_duration_s":1.302171,"scheduling_latency_s":1.302183,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009064,"completed_at":"2026-09-14T08:37:07.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 174.043741] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acdf5a42ae37517c1c8ef41e","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acdf5a42ae37517c1c8ef41e: start","job_status":"start","queue_duration_s":1.312024,"scheduling_latency_s":1.312038}1628gitlab # [ 174.044558] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acdf5a42ae37517c1c8ef41e","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acdf5a42ae37517c1c8ef41e: done: 0.008882 sec","job_status":"done","queue_duration_s":1.312024,"scheduling_latency_s":1.312038,"redis_calls":13,"redis_duration_s":0.00142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008882,"completed_at":"2026-09-14T08:37:07.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 174.090671] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63fa9485cbdacebf64f6bc9d","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63fa9485cbdacebf64f6bc9d: start","job_status":"start","queue_duration_s":1.321862,"scheduling_latency_s":1.321875}1630gitlab # [ 174.091443] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63fa9485cbdacebf64f6bc9d","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63fa9485cbdacebf64f6bc9d: done: 0.008878 sec","job_status":"done","queue_duration_s":1.321862,"scheduling_latency_s":1.321875,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008878,"completed_at":"2026-09-14T08:37:07.108Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 174.101699] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24e9fad8dbbb6f72711cf98e","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24e9fad8dbbb6f72711cf98e: start","job_status":"start","queue_duration_s":1.331537,"scheduling_latency_s":1.33155}1632gitlab # [ 174.142721] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:07.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24e9fad8dbbb6f72711cf98e","created_at":"2026-09-14T08:37:05.703Z","trace_propagation_headers":{"sentry-trace":"1b7d0a3b59b74e26afa836c9b06d3a9e-0fbe4f51f71e4f11","baggage":"sentry-trace_id=1b7d0a3b59b74e26afa836c9b06d3a9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"655d0614ac595b4955a42ebabff855d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:05.778Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24e9fad8dbbb6f72711cf98e: done: 0.008851 sec","job_status":"done","queue_duration_s":1.331537,"scheduling_latency_s":1.33155,"redis_calls":13,"redis_duration_s":0.001408,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008851,"completed_at":"2026-09-14T08:37:07.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 179.995194] postgres[2412]: [2412] ERROR: relation "table_without_models" does not exist1634gitlab # [ 179.995568] postgres[2412]: [2412] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1635gitlab # [ 182.824418] runuser[2209]: pam_unix(runuser:session): session closed for user gitlab1636gitlab # [ 182.825704] setup-gitlab-start[2187]: + systemctl restart gitlab-sidekiq.service1637gitlab # [ 182.844824] systemd[1]: Stopping gitlab-sidekiq.service...1638gitlab # [ 182.851247] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:17.161Z","message":"Shutting down"}1639gitlab # [ 182.852670] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:17.161Z","message":"Scheduler exiting..."}1640gitlab # [ 182.854207] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:17.162Z","message":"Terminating quiet threads for default capsule"}1641gitlab # [ 182.855834] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:17.162Z","message":"Scheduler exiting..."}1642gitlab # [ 183.355662] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:17.665Z","message":"Bye!"}1643gitlab # [ 183.382930] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-09-14T08:37:17.693Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1609,"worker_id":"sidekiq_0","memwd_rss_bytes":947367936,"retry":0}1644gitlab # [ 184.749764] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1645gitlab # [ 184.752459] systemd[1]: Stopped gitlab-sidekiq.service.1646gitlab # [ 184.754458] systemd[1]: gitlab-sidekiq.service: Consumed 56.933s CPU time over 1min 53.034s wall clock time, 959.4M memory peak, 4.4M read from disk.1647gitlab # [ 184.759067] systemd[1]: Started gitlab-sidekiq.service.1648gitlab # [ 184.762863] setup-gitlab-start[2187]: + mkdir -p /var/lib/secrets1649gitlab # [ 184.769186] setup-gitlab-start[2187]: + echo nixbot-test-token-of-20-chars1650gitlab # [ 184.771531] setup-gitlab-start[2187]: + chmod 644 /var/lib/secrets/gitlab-token1651gitlab # [ 184.774566] setup-gitlab-start[2187]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1652gitlab # [ 185.010990] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:19 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1961653gitlab # [ 185.461485] gitaly[911]: time="2026-09-14T08:37:19.770Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:29.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:19.770" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1654gitlab # [ 185.462265] gitaly[911]: time="2026-09-14T08:37:19.770Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:29.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:19.770" grpc.time_ms=0.276 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 185.622748] gitaly[911]: time="2026-09-14T08:37:19.933Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:29.172" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:19.932" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1656gitlab # [ 185.643657] gitaly[911]: time="2026-09-14T08:37:19.954Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:29.172" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:19.932" grpc.time_ms=0.419 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 185.718987] gitaly[911]: time="2026-09-14T08:37:20.029Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE diskcache=801cc3d9-b9dd-4e74-81f6-cde41c39edc0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T08:37:29.214" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:19.975" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 185.739444] gitaly[911]: time="2026-09-14T08:37:20.029Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1573 command.oublock=32 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T08:37:29.214" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:19.975" grpc.time_ms=54.124 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 185.757198] gitaly[911]: time="2026-09-14T08:37:20.067Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:30.026" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.067" pid=911 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1660gitlab # [ 185.766568] gitaly[911]: time="2026-09-14T08:37:20.067Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:30.026" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.067" grpc.time_ms=0.373 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1661gitlab # [ 185.776623] gitaly[911]: time="2026-09-14T08:37:20.082Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T08:37:30.031" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.072" grpc.time_ms=9.739 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1662gitlab # [ 185.822661] gitaly[911]: time="2026-09-14T08:37:20.133Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:30.092" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.132" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1663gitlab # [ 185.823291] gitaly[911]: time="2026-09-14T08:37:20.133Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:30.092" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.132" grpc.time_ms=0.209 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1664gitlab # [ 185.879904] gitaly[911]: time="2026-09-14T08:37:20.190Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE diskcache=ec2eaf27-4bfe-4736-a772-40247654e94e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T08:37:30.113" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.153" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1665gitlab # [ 185.889353] gitaly[911]: time="2026-09-14T08:37:20.190Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1578 command.oublock=32 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T08:37:30.113" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.153" grpc.time_ms=36.735 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1666gitlab # [ 185.889777] gitaly[911]: time="2026-09-14T08:37:20.196Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:30.155" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.195" pid=911 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1667gitlab # [ 185.890413] gitaly[911]: time="2026-09-14T08:37:20.197Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:30.155" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.195" grpc.time_ms=1.274 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1668gitlab # [ 185.901732] gitaly[911]: time="2026-09-14T08:37:20.212Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T08:37:30.162" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.202" grpc.time_ms=9.816 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669gitlab # [ 185.932267] gitaly[911]: time="2026-09-14T08:37:20.242Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:37:30.202" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.242" grpc.time_ms=0.138 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1670gitlab # [ 185.941965] gitaly[911]: time="2026-09-14T08:37:20.249Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-14T08:37:30.208" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.248" grpc.time_ms=0.167 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1671gitlab # [ 186.380291] gitaly[911]: time="2026-09-14T08:37:20.690Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0HVCTBES6ERSHGS5RDPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T08:37:30.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:20.682" grpc.time_ms=8.395 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672gitlab # [ 186.601451] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:20 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 15701673gitlab # [ 186.605875] setup-gitlab-start[2458]: {"id":1,"message":null,"error":null}1674gitlab # [ 187.784298] sidekiq-cluster[2446]: {"severity":"INFO","time":"2026-09-14T08:37:22.077Z","message":"Starting cluster with 1 processes"}1675gitlab # [ 191.734229] gitaly[911]: time="2026-09-14T08:37:26.044Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0R992M9EQDX8AS2H3WN3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T08:37:36.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:26.039" grpc.time_ms=5.058 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 191.793502] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:26 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1721677gitlab # [ 191.797482] setup-gitlab-start[2187]: + mkdir -p /tmp/test-flake1678gitlab # [ 191.800044] setup-gitlab-start[2187]: + cd /tmp/test-flake1679gitlab # [ 191.800444] setup-gitlab-start[2187]: + git init -b master1680gitlab # [ 191.830324] setup-gitlab-start[2532]: Initialized empty Git repository in /tmp/test-flake/.git/1681gitlab # [ 191.831540] setup-gitlab-start[2187]: + git config user.name test1682gitlab # [ 191.834049] setup-gitlab-start[2187]: + git config user.email test@example.com1683gitlab # [ 191.837252] setup-gitlab-start[2187]: + cat1684gitlab # [ 191.840038] setup-gitlab-start[2187]: + git add flake.nix1685gitlab # [ 191.844166] setup-gitlab-start[2187]: + git commit -m 'initial commit'1686gitlab # [ 191.862090] setup-gitlab-start[2537]: [master (root-commit) 00133f1] initial commit1687gitlab # [ 191.863232] setup-gitlab-start[2537]: 1 file changed, 10 insertions(+)1688gitlab # [ 191.864444] setup-gitlab-start[2537]: create mode 100644 flake.nix1689gitlab # [ 191.865352] setup-gitlab-start[2187]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1690gitlab # [ 191.867388] setup-gitlab-start[2187]: + git push -u origin master1691gitlab # [ 192.138980] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:26 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 2531692gitlab # [ 192.407473] gitaly[911]: time="2026-09-14T08:37:26.717Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0RSMMTH03PAZ4FXF43ZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:26.707" grpc.time_ms=10.019 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1693gitlab # [ 192.419898] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:26 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2661694gitlab # [ 192.643211] gitaly[911]: time="2026-09-14T08:37:26.953Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T08:37:36.181" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:26.942" grpc.time_ms=10.945 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1695gitlab # [ 192.705663] gitaly[911]: time="2026-09-14T08:37:27.015Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-14T08:37:57.004" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-14T08:37:27.004" grpc.time_ms=11.377 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1696gitlab # [ 192.734908] gitaly[911]: time="2026-09-14T08:37:27.033Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 duration_ms=152ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/allowed"1697gitlab # [ 192.776744] gitaly[911]: time="2026-09-14T08:37:27.087Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 duration_ms=53ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/pre_receive"1698gitlab # [ 192.777709] gitaly[911]: time="2026-09-14T08:37:27.088Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:37:26.879" grpc.time_ms=208.644 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1699gitlab # [ 192.839423] gitaly[911]: time="2026-09-14T08:37:27.149Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:37:27.148" grpc.time_ms=1.11 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1700gitlab # [ 192.873960] gitaly[911]: time="2026-09-14T08:37:27.184Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:37:27.183" grpc.time_ms=0.368 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1701gitlab # [ 192.902572] gitaly[911]: time="2026-09-14T08:37:27.213Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:37:27.212" grpc.time_ms=0.562 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1702gitlab # [ 193.028792] gitaly[911]: time="2026-09-14T08:37:27.339Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T08:37:37.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:27.327" grpc.time_ms=11.11 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703gitlab # [ 193.085163] gitaly[911]: time="2026-09-14T08:37:27.395Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1565 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-14T08:37:37.054" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:37:27.375" grpc.time_ms=19.89 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704gitlab # [ 193.117651] gitaly[911]: time="2026-09-14T08:37:27.428Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 duration_ms=186ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/post_receive"1705gitlab # [ 193.121392] gitaly[911]: time="2026-09-14T08:37:27.431Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:37:27.241" grpc.time_ms=190.277 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1706gitlab # [ 193.142307] gitaly[911]: time="2026-09-14T08:37:27.452Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 diskcache=225f8c5c-0f08-4e11-9d43-13c90bada49c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:26.814" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1707gitlab # [ 193.143202] gitaly[911]: time="2026-09-14T08:37:27.452Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=189 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13791 command.oublock=32 command.real_time_ms=627 command.spawn_token_fork_ms=1 command.system_time_ms=123 command.user_time_ms=66 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:26.814" grpc.time_ms=638.767 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1708gitlab # [ 193.164363] gitlab-workhorse[829]: time="2026-09-14T08:37:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521709gitlab # [ 193.164971] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:27 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7371710gitlab # [ 193.169433] setup-gitlab-start[2541]: To http://gitlab/root/test-flake.git1711gitlab # [ 193.169622] setup-gitlab-start[2541]: * [new branch] master -> master1712gitlab # [ 193.174629] setup-gitlab-start[2541]: branch 'master' set up to track 'origin/master'.1713gitlab # [ 193.178735] systemd[1]: Finished setup-gitlab.service.1714gitlab # [ 193.184371] systemd[1]: Starting nixbot CI service...1715gitlab: (finished: waiting for unit setup-gitlab.service, in 194.62 seconds)1716gitlab: waiting for unit nixbot.service1717gitlab # [ 194.412645] nixbot[2628]: {"ts": "2026-09-14T08:37:28.722Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1718gitlab # [ 194.444705] nixbot[2628]: {"ts": "2026-09-14T08:37:28.755Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1719gitlab # [ 194.475763] nixbot[2628]: {"ts": "2026-09-14T08:37:28.785Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1720gitlab # [ 194.484984] nixbot[2628]: {"ts": "2026-09-14T08:37:28.795Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1721gitlab # [ 194.495443] nixbot[2628]: {"ts": "2026-09-14T08:37:28.805Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1722gitlab # [ 194.508706] nixbot[2628]: {"ts": "2026-09-14T08:37:28.819Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1723gitlab # [ 194.517540] nixbot[2628]: {"ts": "2026-09-14T08:37:28.827Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1724gitlab # [ 194.524325] nixbot[2628]: {"ts": "2026-09-14T08:37:28.834Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1725gitlab # [ 194.535709] nixbot[2628]: {"ts": "2026-09-14T08:37:28.846Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1726gitlab # [ 194.542493] nixbot[2628]: {"ts": "2026-09-14T08:37:28.852Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1727gitlab # [ 194.552378] nixbot[2628]: {"ts": "2026-09-14T08:37:28.862Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1728gitlab # [ 194.562214] nixbot[2628]: {"ts": "2026-09-14T08:37:28.872Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1729gitlab # [ 194.566993] nixbot[2628]: {"ts": "2026-09-14T08:37:28.877Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1730gitlab # [ 194.571711] nixbot[2628]: {"ts": "2026-09-14T08:37:28.882Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1731gitlab # [ 194.577062] nixbot[2628]: {"ts": "2026-09-14T08:37:28.887Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1732gitlab # [ 194.581257] nixbot[2628]: {"ts": "2026-09-14T08:37:28.891Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1733gitlab # [ 194.585363] nixbot[2628]: {"ts": "2026-09-14T08:37:28.895Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1734gitlab # [ 194.589279] nixbot[2628]: {"ts": "2026-09-14T08:37:28.899Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1735gitlab # [ 194.594995] nixbot[2628]: {"ts": "2026-09-14T08:37:28.905Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1736gitlab # [ 194.599114] nixbot[2628]: {"ts": "2026-09-14T08:37:28.909Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1737gitlab # [ 194.603079] nixbot[2628]: {"ts": "2026-09-14T08:37:28.913Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1738gitlab # [ 194.611699] nixbot[2628]: {"ts": "2026-09-14T08:37:28.922Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1739gitlab # [ 194.615921] nixbot[2628]: {"ts": "2026-09-14T08:37:28.926Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1740gitlab # [ 194.620927] nixbot[2628]: {"ts": "2026-09-14T08:37:28.931Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1741gitlab # [ 194.624859] nixbot[2628]: {"ts": "2026-09-14T08:37:28.935Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1742gitlab # [ 194.629270] nixbot[2628]: {"ts": "2026-09-14T08:37:28.939Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1743gitlab # [ 194.633409] nixbot[2628]: {"ts": "2026-09-14T08:37:28.943Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1744gitlab # [ 194.637240] nixbot[2628]: {"ts": "2026-09-14T08:37:28.947Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1745gitlab # [ 194.641113] nixbot[2628]: {"ts": "2026-09-14T08:37:28.951Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1746gitlab # [ 194.657613] nixbot[2628]: {"ts": "2026-09-14T08:37:28.967Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1747gitlab # [ 194.665350] nixbot[2628]: {"ts": "2026-09-14T08:37:28.975Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1748gitlab # [ 194.668237] nixbot[2628]: {"ts": "2026-09-14T08:37:28.978Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1749gitlab # [ 194.671232] nixbot[2628]: {"ts": "2026-09-14T08:37:28.981Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1750gitlab # [ 194.677921] nixbot[2628]: {"ts": "2026-09-14T08:37:28.988Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1751gitlab # [ 194.680484] nixbot[2628]: {"ts": "2026-09-14T08:37:28.990Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1752gitlab # [ 194.688618] nixbot[2628]: {"ts": "2026-09-14T08:37:28.999Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1753gitlab # [ 195.022430] nixbot[2628]: INFO: Started server process [2628]1754gitlab # [ 195.024717] nixbot[2628]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1755gitlab # [ 195.039795] nixbot[2628]: INFO: ::ffff:127.0.0.1:42126 - "GET /health HTTP/1.1" 200 OK1756gitlab # [ 195.045158] systemd[1]: Started nixbot CI service.1757gitlab # [ 195.047387] systemd[1]: Reached target Multi-User System.1758gitlab # [ 195.049422] systemd[1]: Startup finished in 1.133s (kernel) + 3.603s (initrd) + 3min 10.312s (userspace) = 3min 15.049s.1759gitlab # [ 195.694205] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:30 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 6531760gitlab # [ 195.695574] nixbot[2628]: {"ts": "2026-09-14T08:37:30.004Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1761gitlab # [ 195.708821] nixbot[2628]: {"ts": "2026-09-14T08:37:30.019Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1762gitlab # [ 195.777878] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 591763gitlab # [ 195.782888] nixbot[2628]: {"ts": "2026-09-14T08:37:30.089Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1764gitlab # [ 195.788181] nixbot[2628]: {"ts": "2026-09-14T08:37:30.091Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1765gitlab # [ 195.907622] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1231766gitlab # [ 195.912730] nixbot[2628]: {"ts": "2026-09-14T08:37:30.218Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1767gitlab # [ 196.024611] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:30 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1071768gitlab # [ 196.031955] nixbot[2628]: {"ts": "2026-09-14T08:37:30.342Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1769gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds)1770gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1771gitlab # [ 196.067149] nixbot[2628]: INFO: ::ffff:127.0.0.1:42136 - "GET /health HTTP/1.1" 200 OK1772gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1773subtest: project discovered and webhook registered1774gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1775gitlab # [ 196.133618] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 371776gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds)1777(finished: subtest: project discovered and webhook registered, in 0.07 seconds)1778subtest: push delivers the webhook1779gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1780gitlab # [ 196.147176] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 901781gitlab # [ 196.151945] nixbot[2628]: {"ts": "2026-09-14T08:37:30.457Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1782gitlab # [ 196.197151] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:30 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 471783gitlab # [ 196.201319] nixbot[2628]: {"ts": "2026-09-14T08:37:30.508Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1784gitlab # [ 196.245910] gitaly[911]: time="2026-09-14T08:37:30.555Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0WRFNSB330WB2Q5QT08J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-14T08:38:00.040" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:37:30.541" grpc.time_ms=14.171 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 196.289288] gitaly[911]: time="2026-09-14T08:37:30.599Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0WRFNSB330WB2Q5QT08J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:00.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:37:30.598" grpc.time_ms=0.665 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 196.321607] gitaly[911]: time="2026-09-14T08:37:30.632Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0WRFNSB330WB2Q5QT08J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-14T08:37:40.004" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:37:30.625" grpc.time_ms=6.842 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 196.360986] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1591788gitlab # [ 196.362410] nixbot[2628]: {"ts": "2026-09-14T08:37:30.672Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1789gitlab # [ 196.485262] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1171790gitlab # [ 196.491112] nixbot[2628]: {"ts": "2026-09-14T08:37:30.796Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1791gitlab # [ 196.497362] nixbot[2628]: {"ts": "2026-09-14T08:37:30.799Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1792gitlab # [ 196.579509] gitaly[911]: time="2026-09-14T08:37:30.889Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0X2S78TB8HZTT3E1W2FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:30.879" grpc.time_ms=10.344 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1793gitlab # [ 196.580467] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 491794gitlab # [ 196.727592] gitaly[911]: time="2026-09-14T08:37:31.037Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0X4DE2N7CR7SBH2RB05X grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.024" pid=911 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1795gitlab # [ 196.750476] gitaly[911]: time="2026-09-14T08:37:31.038Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0X4DE2N7CR7SBH2RB05X grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.024" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1796gitlab # [ 196.775523] gitlab-workhorse[829]: time="2026-09-14T08:37:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131797gitlab # [ 196.777887] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1481798gitlab # [ 196.779827] gitaly[911]: time="2026-09-14T08:37:31.040Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0X4DE2N7CR7SBH2RB05X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.024" grpc.time_ms=15.296 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1799gitlab # [ 196.808298] gitaly[911]: time="2026-09-14T08:37:31.118Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0X9561YK320SWN7BBPVD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.098" pid=911 remote_ip="2001:db8:1::1" request_sha=0ce05d1b0580afe93ecdcd9538a973e79a48d7b7 response_bytes=223 span.kind=server system=grpc1800gitlab # [ 196.818936] gitaly[911]: time="2026-09-14T08:37:31.118Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0X9561YK320SWN7BBPVD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.098" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1801gitlab # [ 196.831631] gitlab-workhorse[829]: time="2026-09-14T08:37:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231802gitlab # [ 196.833982] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 731803gitlab # [ 196.834887] gitaly[911]: time="2026-09-14T08:37:31.119Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0X9561YK320SWN7BBPVD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.098" grpc.time_ms=20.889 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1804gitlab # [ 196.923889] gitaly[911]: time="2026-09-14T08:37:31.234Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XDN38BQ4A1NS1H1NMY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.226" grpc.time_ms=7.828 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1805gitlab # [ 196.949842] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 461806gitlab # [ 196.969458] gitaly[911]: time="2026-09-14T08:37:31.279Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XF50YMT9GBY21E6N58D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.271" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1807gitlab # [ 196.969685] gitaly[911]: time="2026-09-14T08:37:31.280Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XF50YMT9GBY21E6N58D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.271" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1808gitlab # [ 196.970583] gitaly[911]: time="2026-09-14T08:37:31.280Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XF50YMT9GBY21E6N58D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.271" grpc.time_ms=9.243 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1809gitlab # [ 196.971502] gitlab-workhorse[829]: time="2026-09-14T08:37:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671810gitlab # [ 196.972406] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 441811gitlab # [ 197.087646] gitaly[911]: time="2026-09-14T08:37:31.398Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XJWZQMJ8KJZ6X4N2BDP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.390" grpc.time_ms=7.848 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1812gitlab # [ 197.088735] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421813gitlab # [ 197.153894] gitaly[911]: time="2026-09-14T08:37:31.464Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XM9P1AV9SVXDZEW9ZFD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.437" pid=911 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=214 span.kind=server system=grpc1814gitlab # [ 197.154235] gitaly[911]: time="2026-09-14T08:37:31.464Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XM9P1AV9SVXDZEW9ZFD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.437" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1815gitlab # [ 197.154922] gitaly[911]: time="2026-09-14T08:37:31.465Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XM9P1AV9SVXDZEW9ZFD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:31.437" grpc.time_ms=27.518 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1816gitlab # [ 197.156725] gitlab-workhorse[829]: time="2026-09-14T08:37:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2141817gitlab # [ 197.157855] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 214 "" "git/2.55.0" 631818gitlab # [ 197.308349] gitaly[911]: time="2026-09-14T08:37:31.618Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:01.616" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:37:31.617" grpc.time_ms=0.956 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 197.349552] gitaly[911]: time="2026-09-14T08:37:31.659Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-14T08:38:01.649" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:37:31.649" grpc.time_ms=10.236 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 197.396165] gitaly[911]: time="2026-09-14T08:37:31.706Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:37:41.014" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:37:31.694" grpc.time_ms=11.819 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 197.412177] gitaly[911]: time="2026-09-14T08:37:31.722Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:37:41.033" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:37:31.714" grpc.time_ms=8.264 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 197.474609] gitaly[911]: time="2026-09-14T08:37:31.784Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-14T08:37:41.023" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:31.784" grpc.time_ms=0.501 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 197.496679] gitaly[911]: time="2026-09-14T08:37:31.798Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-14T08:37:41.030" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:37:31.791" grpc.time_ms=6.907 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 197.525451] gitaly[911]: time="2026-09-14T08:37:31.835Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:37:31.834" grpc.time_ms=0.833 pid=911 span.kind=server system=grpc1825gitlab # [ 197.560458] gitaly[911]: time="2026-09-14T08:37:31.870Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:37:31.870" grpc.time_ms=0.384 pid=911 span.kind=server system=grpc1826gitlab # [ 197.578812] gitaly[911]: time="2026-09-14T08:37:31.889Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 diskcache=57ef6d7a-7f25-4a4d-a400-f90b68d7aa3a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T08:37:41.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:31.800" pid=911 ref=refs/keep-around/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 remote_ip="2001:db8:1::1" revision=00133f1f38ec45f9af780822105d5f6e8e8ff7e6 span.kind=server system=grpc username=root1827gitlab # [ 197.589221] gitaly[911]: time="2026-09-14T08:37:31.899Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=60 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5309 command.oublock=8 command.real_time_ms=79 command.spawn_token_fork_ms=1 command.system_time_ms=31 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T08:37:41.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:37:31.800" grpc.time_ms=89.031 pid=911 ref=refs/keep-around/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 remote_ip="2001:db8:1::1" revision=00133f1f38ec45f9af780822105d5f6e8e8ff7e6 span.kind=server system=grpc username=root1828gitlab # [ 197.607608] gitaly[911]: time="2026-09-14T08:37:31.917Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:01.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:37:31.917" grpc.time_ms=0.452 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1829gitlab # [ 197.723877] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:32 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4621830gitlab # [ 197.730820] nixbot[2628]: {"ts": "2026-09-14T08:37:32.034Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 \"HTTP/1.1 201 Created\""}1831gitlab # [ 197.737462] nixbot[2628]: {"ts": "2026-09-14T08:37:32.044Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-00133f1f38ec-0"}1832gitlab # [ 197.902072] nixbot[2628]: {"ts": "2026-09-14T08:37:32.212Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-00133f1f38ec-0", "argv0": "bwrap"}1833gitlab # [ 198.006893] systemd[1]: Started Nix Daemon.1834gitlab # [ 198.062771] nix-daemon[2785]: accepted connection from pid 2780, user nixbot1835gitlab # [ 203.079721] nix-daemon[2785]: accepted connection from pid 2834, user nixbot1836gitlab # [ 203.095693] nix-daemon[2785]: accepted connection from pid 2780, user nixbot1837gitlab # [ 207.075135] nix-daemon[2785]: accepted connection from pid 2780, user nixbot1838gitlab # [ 207.186219] nix-daemon[2785]: accepted connection from pid 2876, user nixbot1839gitlab # [ 207.236157] gitaly[911]: time="2026-09-14T08:37:41.545Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH17F0Z4188VBS9SZFJD0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:11.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:37:41.544" grpc.time_ms=0.877 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1840gitlab # [ 207.389135] gitaly[911]: time="2026-09-14T08:37:41.699Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH17F0Z4188VBS9SZFJD0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:37:51.068" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:37:41.689" grpc.time_ms=10.173 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1841gitlab # [ 207.475292] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3121842gitlab # [ 207.476932] nixbot[2628]: {"ts": "2026-09-14T08:37:41.786Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 \"HTTP/1.1 201 Created\""}1843gitlab # [ 207.528672] gitaly[911]: time="2026-09-14T08:37:41.839Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH17S0VTWVXF58JGBHYY2X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:11.837" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:37:41.837" grpc.time_ms=0.889 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1844gitlab # [ 207.557695] gitaly[911]: time="2026-09-14T08:37:41.868Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH17S0VTWVXF58JGBHYY2X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:37:51.182" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:37:41.862" grpc.time_ms=5.407 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 207.612675] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1301846gitlab # [ 207.615456] nixbot[2628]: {"ts": "2026-09-14T08:37:41.924Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 \"HTTP/1.1 201 Created\""}1847gitlab # [ 212.066449] sidekiq-cluster[2503]: 2026-09-14T08:37:46.375Z pid=2503 tid=xv3 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2503, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433745920}1848gitlab # [ 212.233937] sidekiq-cluster[2503]: W, [2026-09-14T08:37:46.544174 #2503] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1849gitlab # [ 212.271183] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:37:46.581Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1850gitlab # [ 212.448745] nix-daemon[2785]: accepted connection from pid 2954, user nixbot1851gitlab # [ 212.541813] gitaly[911]: time="2026-09-14T08:37:46.851Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH1CNAPBSTAR354T2ZPR4M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:16.349" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:37:46.850" grpc.time_ms=0.93 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1852gitlab # [ 212.620405] gitaly[911]: time="2026-09-14T08:37:46.930Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FH1CNAPBSTAR354T2ZPR4M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:37:56.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:37:46.917" grpc.time_ms=12.501 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 212.674522] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1891854gitlab # [ 212.681754] nixbot[2628]: {"ts": "2026-09-14T08:37:46.991Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 \"HTTP/1.1 201 Created\""}1855gitlab # [ 213.062844] gitaly[911]: time="2026-09-14T08:37:47.373Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2FH1D58P618RCQBFBV5EB1D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:47.359" grpc.time_ms=12.868 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1856gitlab # [ 213.092220] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 971857gitlab # [ 213.170138] gitaly[911]: time="2026-09-14T08:37:47.479Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH1D8E381R61DJN02WDQFY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:47.467" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1858gitlab # [ 213.170447] gitaly[911]: time="2026-09-14T08:37:47.480Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH1D8E381R61DJN02WDQFY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:47.467" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1859gitlab # [ 213.171524] gitlab-workhorse[829]: time="2026-09-14T08:37:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671860gitlab # [ 213.176108] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 741861gitlab # [ 213.223774] gitaly[911]: time="2026-09-14T08:37:47.534Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH1D8E381R61DJN02WDQFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:47.467" grpc.time_ms=13.293 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1862gitlab # [ 213.308429] gitaly[911]: time="2026-09-14T08:37:47.618Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH1DDNHQNX8ZVB866GCXFN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:47.609" grpc.time_ms=9.147 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1863gitlab # [ 213.308767] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 451864gitlab # [ 213.360966] gitaly[911]: time="2026-09-14T08:37:47.671Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH1DF4GDBQ5ZMS78829A14 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:47.664" pid=911 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1865gitlab # [ 213.361444] gitaly[911]: time="2026-09-14T08:37:47.671Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH1DF4GDBQ5ZMS78829A14 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:47.664" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1866gitlab # [ 213.362194] gitaly[911]: time="2026-09-14T08:37:47.671Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH1DF4GDBQ5ZMS78829A14 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:37:47.664" grpc.time_ms=6.719 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1867gitlab # [ 213.395147] gitlab-workhorse[829]: time="2026-09-14T08:37:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671868gitlab # [ 213.397153] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:37:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 841869gitlab # [ 213.937364] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:37:48.246Z","message":"GitLab reliable fetch activated!"}1870gitlab # [ 213.941241] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:37:48.246Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1871gitlab # [ 234.145937] postgres[3177]: [3177] ERROR: relation "table_without_models" does not exist1872gitlab # [ 234.146747] postgres[3177]: [3177] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1873gitlab # [ 236.521824] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:10.827Z","message":"Booted Rails 7.2.3.1 application in production environment"}1874gitlab # [ 236.526327] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:10.828Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1875gitlab # [ 236.530798] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:10.829Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1876gitlab # [ 236.534839] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:10.829Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1877gitlab # [ 236.539508] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:10.832Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1878gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 40.56 seconds)1879gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1880gitlab # [ 236.777458] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:11 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 211881gitlab # [ 236.860533] gitaly[911]: time="2026-09-14T08:38:11.169Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24CPEC31E7FV8NNEKQ0H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:11.159" grpc.time_ms=9.679 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1882gitlab # [ 236.890116] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:11 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 751883gitlab # Enumerating objects: 5, done.1884gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1885gitlab # Delta compression using up to 4 threads1886gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1887gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1888gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1889gitlab # [ 237.090292] gitaly[911]: time="2026-09-14T08:38:11.400Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-14T08:38:41.091" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-14T08:38:11.392" grpc.time_ms=7.875 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1890gitlab # [ 237.140597] gitaly[911]: time="2026-09-14T08:38:11.451Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH duration_ms=107ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/allowed"1891gitlab # [ 237.172542] gitaly[911]: time="2026-09-14T08:38:11.482Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH duration_ms=24ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/pre_receive"1892gitlab # [ 237.179343] gitaly[911]: time="2026-09-14T08:38:11.489Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:11.343" grpc.time_ms=146.385 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1893gitlab # [ 237.240193] gitaly[911]: time="2026-09-14T08:38:11.550Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:11.549" grpc.time_ms=0.747 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1894gitlab # [ 237.297649] gitaly[911]: time="2026-09-14T08:38:11.608Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:11.607" grpc.time_ms=0.36 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1895gitlab # [ 237.338694] gitaly[911]: time="2026-09-14T08:38:11.649Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:11.648" grpc.time_ms=0.451 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1896gitlab # [ 237.408215] gitaly[911]: time="2026-09-14T08:38:11.718Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH duration_ms=30ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/post_receive"1897gitlab # [ 237.418219] gitaly[911]: time="2026-09-14T08:38:11.718Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:11.687" grpc.time_ms=31.558 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1898gitlab # [ 237.446176] gitaly[911]: time="2026-09-14T08:38:11.756Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH diskcache=4c16aeaf-eef8-4f63-a29b-243f5166a8b6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:11.273" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1899gitlab # To http://gitlab/root/test-flake.git1900gitlab # 00133f1..c3ed311 master -> master1901gitlab # [ 237.456537] gitaly[911]: time="2026-09-14T08:38:11.756Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=207 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13876 command.oublock=32 command.real_time_ms=471 command.spawn_token_fork_ms=0 command.system_time_ms=124 command.user_time_ms=83 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:11.273" grpc.time_ms=483.536 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1902gitlab # [ 237.468927] gitlab-workhorse[829]: time="2026-09-14T08:38:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521903gitlab # [ 237.471149] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:11 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5351904gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.77 seconds)1905gitlab: must succeed: git -C /tmp/test-flake rev-parse master1906gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1907gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea'1908gitlab # [ 237.553106] nixbot[2628]: INFO: ::ffff:127.0.0.1:36934 - "GET /api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 200 OK1909gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', in 0.07 seconds)1910gitlab # [ 237.815992] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.125Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7498145878157e718d41b489","created_at":"2026-09-14T08:37:20.092Z","trace_propagation_headers":{"sentry-trace":"a3c90b53496c49baaf090e85126ad1ff-69b9aa0e9beb41f1","baggage":"sentry-trace_id=a3c90b53496c49baaf090e85126ad1ff,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0HVCTBES6ERSHGS5RDPE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:20.117Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7498145878157e718d41b489: start","job_status":"start","queue_duration_s":52.007853,"scheduling_latency_s":52.0079}1911gitlab # [ 238.026573] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.336Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7498145878157e718d41b489","created_at":"2026-09-14T08:37:20.092Z","trace_propagation_headers":{"sentry-trace":"a3c90b53496c49baaf090e85126ad1ff-69b9aa0e9beb41f1","baggage":"sentry-trace_id=a3c90b53496c49baaf090e85126ad1ff,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0HVCTBES6ERSHGS5RDPE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:20.117Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7498145878157e718d41b489: done: 0.210728 sec","job_status":"done","queue_duration_s":52.007853,"scheduling_latency_s":52.0079,"redis_calls":25,"redis_duration_s":0.006812,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.00355,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001763,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001499,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.101118438,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.210728,"completed_at":"2026-09-14T08:38:12.336Z","load_balancing_strategy":"primary","db_duration_s":0.052062,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1912gitlab # [ 238.028123] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.338Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"85c7946fc15ffee2924fab94","created_at":"2026-09-14T08:37:20.125Z","trace_propagation_headers":{"sentry-trace":"a3c90b53496c49baaf090e85126ad1ff-69b9aa0e9beb41f1","baggage":"sentry-trace_id=a3c90b53496c49baaf090e85126ad1ff,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0HVCTBES6ERSHGS5RDPE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:20.129Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-85c7946fc15ffee2924fab94: start","job_status":"start","queue_duration_s":52.208609,"scheduling_latency_s":52.208635}1913gitlab # [ 238.099071] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.406Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"85c7946fc15ffee2924fab94","created_at":"2026-09-14T08:37:20.125Z","trace_propagation_headers":{"sentry-trace":"a3c90b53496c49baaf090e85126ad1ff-69b9aa0e9beb41f1","baggage":"sentry-trace_id=a3c90b53496c49baaf090e85126ad1ff,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0HVCTBES6ERSHGS5RDPE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:20.129Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-85c7946fc15ffee2924fab94: done: 0.068444 sec","job_status":"done","queue_duration_s":52.208609,"scheduling_latency_s":52.208635,"redis_calls":14,"redis_duration_s":0.003633,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000789,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001597,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001247,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.049506571,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.068444,"completed_at":"2026-09-14T08:38:12.406Z","load_balancing_strategy":"primary","db_duration_s":0.012594,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1914gitlab # [ 238.112448] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.408Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"c86446d3204cf9f20cfb5a75","created_at":"2026-09-14T08:37:20.588Z","trace_propagation_headers":{"sentry-trace":"a3c90b53496c49baaf090e85126ad1ff-69b9aa0e9beb41f1","baggage":"sentry-trace_id=a3c90b53496c49baaf090e85126ad1ff,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0HVCTBES6ERSHGS5RDPE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:20.593Z","job_size_bytes":5,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-c86446d3204cf9f20cfb5a75: start","job_status":"start","queue_duration_s":51.81429,"scheduling_latency_s":51.814303}1915gitlab # [ 238.213173] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.523Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"c86446d3204cf9f20cfb5a75","created_at":"2026-09-14T08:37:20.588Z","trace_propagation_headers":{"sentry-trace":"a3c90b53496c49baaf090e85126ad1ff-69b9aa0e9beb41f1","baggage":"sentry-trace_id=a3c90b53496c49baaf090e85126ad1ff,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0HVCTBES6ERSHGS5RDPE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:20.593Z","job_size_bytes":5,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-c86446d3204cf9f20cfb5a75: done: 0.115214 sec","job_status":"done","queue_duration_s":51.81429,"scheduling_latency_s":51.814303,"redis_calls":12,"redis_duration_s":0.002793,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000658,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001682,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000284393,"duration_s":0.115214,"completed_at":"2026-09-14T08:38:12.523Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026788,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1916gitlab # [ 238.214193] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.524Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"5b2813bc3d91962f40e218b9","created_at":"2026-09-14T08:37:20.613Z","trace_propagation_headers":{"sentry-trace":"a3c90b53496c49baaf090e85126ad1ff-69b9aa0e9beb41f1","baggage":"sentry-trace_id=a3c90b53496c49baaf090e85126ad1ff,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0HVCTBES6ERSHGS5RDPE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:20.617Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-5b2813bc3d91962f40e218b9: start","job_status":"start","queue_duration_s":51.907487,"scheduling_latency_s":51.907501}1917gitlab # [ 238.363872] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.673Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"5b2813bc3d91962f40e218b9","created_at":"2026-09-14T08:37:20.613Z","trace_propagation_headers":{"sentry-trace":"a3c90b53496c49baaf090e85126ad1ff-69b9aa0e9beb41f1","baggage":"sentry-trace_id=a3c90b53496c49baaf090e85126ad1ff,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0HVCTBES6ERSHGS5RDPE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:20.617Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-5b2813bc3d91962f40e218b9: done: 0.149374 sec","job_status":"done","queue_duration_s":51.907487,"scheduling_latency_s":51.907501,"redis_calls":11,"redis_duration_s":0.002693,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000681,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001521,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.124,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.124,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000355632,"duration_s":0.149374,"completed_at":"2026-09-14T08:38:12.673Z","load_balancing_strategy":"primary","db_duration_s":0.07018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1918gitlab # [ 238.364878] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.675Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"adcc65b73b82f687b3529cc4","created_at":"2026-09-14T08:37:20.618Z","trace_propagation_headers":{"sentry-trace":"a3c90b53496c49baaf090e85126ad1ff-69b9aa0e9beb41f1","baggage":"sentry-trace_id=a3c90b53496c49baaf090e85126ad1ff,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0HVCTBES6ERSHGS5RDPE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:20.622Z","job_size_bytes":89,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-adcc65b73b82f687b3529cc4: start","job_status":"start","queue_duration_s":52.053179,"scheduling_latency_s":52.053192}1919gitlab # [ 238.436938] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.701Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"adcc65b73b82f687b3529cc4","created_at":"2026-09-14T08:37:20.618Z","trace_propagation_headers":{"sentry-trace":"a3c90b53496c49baaf090e85126ad1ff-69b9aa0e9beb41f1","baggage":"sentry-trace_id=a3c90b53496c49baaf090e85126ad1ff,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0HVCTBES6ERSHGS5RDPE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:20.622Z","job_size_bytes":89,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-adcc65b73b82f687b3529cc4: done: 0.02604 sec","job_status":"done","queue_duration_s":52.053179,"scheduling_latency_s":52.053192,"redis_calls":11,"redis_duration_s":0.002431,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000716,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000389,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277969,"duration_s":0.02604,"completed_at":"2026-09-14T08:38:12.701Z","load_balancing_strategy":"primary","db_duration_s":0.005578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1920gitlab # [ 238.451680] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.702Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 00133f1f38ec45f9af780822105d5f6e8e8ff7e6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"95f75cf6bfea48494049048d","created_at":"2026-09-14T08:37:27.274Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-69b85da28d2942dd","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:27.295Z","job_size_bytes":185,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-95f75cf6bfea48494049048d: start","job_status":"start","queue_duration_s":45.407414,"scheduling_latency_s":45.407428}1921gitlab # [ 238.466876] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:12.713Z","message":"changes: \"0000000000000000000000000000000000000000 00133f1f38ec45f9af780822105d5f6e8e8ff7e6 refs/heads/master\\n\""}1922gitlab # [ 238.469482] gitaly[911]: time="2026-09-14T08:38:12.742Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:22.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:12.736" grpc.time_ms=5.674 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923gitlab # [ 238.518644] gitaly[911]: time="2026-09-14T08:38:12.751Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T08:38:22.015" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:38:12.746" grpc.time_ms=5.188 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924gitlab # [ 238.519039] gitaly[911]: time="2026-09-14T08:38:12.796Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-14T08:38:22.054" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:12.785" grpc.time_ms=11.123 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925gitlab # [ 238.519674] gitaly[911]: time="2026-09-14T08:38:12.827Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:12.826" grpc.time_ms=0.289 pid=911 span.kind=server system=grpc1926gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea'1927gitlab # [ 238.573921] gitaly[911]: time="2026-09-14T08:38:12.884Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:12.883" grpc.time_ms=0.634 pid=911 span.kind=server system=grpc1928gitlab # [ 238.592366] gitaly[911]: time="2026-09-14T08:38:12.902Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 diskcache=5e1f3cfa-fdc5-4094-b367-43f32ea084b2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T08:38:22.073" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:38:12.803" pid=911 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1929gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', in 0.04 seconds)1930gitlab # [ 238.602477] gitaly[911]: time="2026-09-14T08:38:12.903Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5079 command.oublock=8 command.real_time_ms=90 command.spawn_token_fork_ms=0 command.system_time_ms=36 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T08:38:22.073" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:38:12.803" grpc.time_ms=99.333 pid=911 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1931gitlab # [ 238.603582] nixbot[2628]: INFO: ::ffff:127.0.0.1:36946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 200 OK1932gitlab # [ 238.604816] gitaly[911]: time="2026-09-14T08:38:12.915Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T08:38:22.184" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:38:12.915" grpc.time_ms=0.139 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 238.621264] gitaly[911]: time="2026-09-14T08:38:12.931Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=938 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-14T08:38:22.189" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:12.919" grpc.time_ms=12.161 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934gitlab # [ 238.675308] gitaly[911]: time="2026-09-14T08:38:12.985Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-14T08:38:42.080" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:12.980" grpc.time_ms=4.977 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1935gitlab # [ 238.705510] gitaly[911]: time="2026-09-14T08:38:13.015Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-14T08:38:23.005" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:38:13.015" grpc.time_ms=0.22 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936gitlab # [ 238.715668] gitaly[911]: time="2026-09-14T08:38:13.022Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-14T08:38:23.007" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-14T08:38:13.017" grpc.time_ms=4.8 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 238.732849] gitaly[911]: time="2026-09-14T08:38:13.043Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:23.027" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:13.038" grpc.time_ms=4.942 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab # [ 238.745859] gitaly[911]: time="2026-09-14T08:38:13.056Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:23.040" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:13.050" grpc.time_ms=5.505 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 238.768842] gitaly[911]: time="2026-09-14T08:38:13.079Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-14T08:38:43.064" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:13.064" grpc.time_ms=14.863 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 239.063221] gitaly[911]: time="2026-09-14T08:38:13.373Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-14T08:38:23.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:13.371" grpc.time_ms=1.801 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 239.115132] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:13.424Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 00133f1f38ec45f9af780822105d5f6e8e8ff7e6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"95f75cf6bfea48494049048d","created_at":"2026-09-14T08:37:27.274Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-69b85da28d2942dd","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:37:27.295Z","job_size_bytes":185,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-95f75cf6bfea48494049048d: done: 0.722014 sec","job_status":"done","queue_duration_s":45.407414,"scheduling_latency_s":45.407428,"gitaly_calls":13,"gitaly_duration_s":0.21923,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.062348999999999995,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.002672,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006303,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001307,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003747,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.014221,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.034099,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.158,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.171,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.405309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000426032,"exclusive_lock_hold_duration_s":0.022167062999999997,"duration_s":0.722014,"completed_at":"2026-09-14T08:38:13.424Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058491,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1942gitlab # [ 239.186309] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:13.425Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c709f67fda79e782b3d92e86","created_at":"2026-09-14T08:37:31.921Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-180008f5081e4426","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:31.931Z","job_size_bytes":65,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c709f67fda79e782b3d92e86: start","job_status":"start","queue_duration_s":41.493816,"scheduling_latency_s":41.49383}1943gitlab # [ 239.187266] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:13.472Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c709f67fda79e782b3d92e86","created_at":"2026-09-14T08:37:31.921Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-180008f5081e4426","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:31.931Z","job_size_bytes":65,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c709f67fda79e782b3d92e86: done: 0.046854 sec","job_status":"done","queue_duration_s":41.493816,"scheduling_latency_s":41.49383,"redis_calls":16,"redis_duration_s":0.002216,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001206,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227403,"duration_s":0.046854,"completed_at":"2026-09-14T08:38:13.472Z","load_balancing_strategy":"primary","db_duration_s":0.009981,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1944gitlab # [ 239.204837] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:13.474Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4dba9b484d112068c7202bb5","created_at":"2026-09-14T08:37:31.932Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-180008f5081e4426","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:31.935Z","job_size_bytes":65,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4dba9b484d112068c7202bb5: start","job_status":"start","queue_duration_s":41.539177,"scheduling_latency_s":41.539224}1945gitlab # [ 239.243795] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:13.544Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4dba9b484d112068c7202bb5","created_at":"2026-09-14T08:37:31.932Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-180008f5081e4426","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:31.935Z","job_size_bytes":65,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4dba9b484d112068c7202bb5: done: 0.069953 sec","job_status":"done","queue_duration_s":41.539177,"scheduling_latency_s":41.539224,"redis_calls":21,"redis_duration_s":0.003968,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001322,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001532,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000295568,"duration_s":0.069953,"completed_at":"2026-09-14T08:38:13.544Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1946gitlab # [ 239.296609] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:13.545Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"19000a4efd667e9befacbe46","created_at":"2026-09-14T08:37:32.017Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-180008f5081e4426","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:32.022Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-19000a4efd667e9befacbe46: start","job_status":"start","queue_duration_s":41.523399,"scheduling_latency_s":41.523413}1947gitlab # [ 239.390186] gitaly[911]: time="2026-09-14T08:38:13.700Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:13.699" grpc.time_ms=0.501 pid=911 span.kind=server system=grpc1948gitlab # [ 239.435786] gitaly[911]: time="2026-09-14T08:38:13.746Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:13.745" grpc.time_ms=0.36 pid=911 span.kind=server system=grpc1949gitlab # [ 239.475850] gitaly[911]: time="2026-09-14T08:38:13.785Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:13.784" grpc.time_ms=1.06 pid=911 span.kind=server system=grpc1950gitlab # [ 239.496284] gitaly[911]: time="2026-09-14T08:38:13.806Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 diskcache=0cb3ac6f-15f3-4ff9-bd62-bbf51650b432 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:43.676" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:13.677" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab # [ 239.505410] gitaly[911]: time="2026-09-14T08:38:13.815Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=110 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7432 command.oublock=0 command.real_time_ms=119 command.spawn_token_fork_ms=0 command.system_time_ms=72 command.user_time_ms=38 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:43.676" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:13.677" grpc.time_ms=129.489 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab # [ 239.573844] gitaly[911]: time="2026-09-14T08:38:13.884Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T08:38:43.882" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:13.883" grpc.time_ms=0.985 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea'1954gitlab # [ 239.623617] gitaly[911]: time="2026-09-14T08:38:13.934Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0XSKC0RPM85381TVP5Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:43.032" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:13.933" grpc.time_ms=0.526 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 239.630187] nixbot[2628]: INFO: ::ffff:127.0.0.1:36948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 200 OK1956gitlab # [ 239.635407] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:13.945Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"19000a4efd667e9befacbe46","created_at":"2026-09-14T08:37:32.017Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-180008f5081e4426","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:32.022Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2503,"job_status":"rescheduled","message":"PipelineProcessWorker JID-19000a4efd667e9befacbe46: rescheduled"}1957gitlab # [ 239.647539] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:13.957Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"19000a4efd667e9befacbe46","created_at":"2026-09-14T08:37:32.017Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-180008f5081e4426","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T08:37:32.022Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-19000a4efd667e9befacbe46: done: 0.411877 sec","job_status":"done","queue_duration_s":41.523399,"scheduling_latency_s":41.523413,"gitaly_calls":3,"gitaly_duration_s":0.17178,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018333000000000002,"redis_read_bytes":460,"redis_write_bytes":29292,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000638,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00103,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.006961,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.002886,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15579,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.003863,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000408,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000338,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001571,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.189477,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.36651445899999996,"duration_s":0.411877,"completed_at":"2026-09-14T08:38:13.957Z","load_balancing_strategy":"primary","db_duration_s":0.037881,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', in 0.12 seconds)1959gitlab # [ 239.691322] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:13.960Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","00133f1f38ec45f9af780822105d5f6e8e8ff7e6 c3ed311f746d9e796bcb062f5c7ef32fcecb83ea refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2befa44f0b426706a04dee3e","created_at":"2026-09-14T08:38:11.706Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-57654ae99488488f","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:11.708Z","job_size_bytes":185,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2befa44f0b426706a04dee3e: start","job_status":"start","queue_duration_s":2.252325,"scheduling_latency_s":2.252357}1960gitlab # [ 239.691868] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:13.975Z","message":"changes: \"00133f1f38ec45f9af780822105d5f6e8e8ff7e6 c3ed311f746d9e796bcb062f5c7ef32fcecb83ea refs/heads/master\\n\""}1961gitlab # [ 239.693286] gitaly[911]: time="2026-09-14T08:38:14.003Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:23.263" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:13.994" grpc.time_ms=8.805 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 239.708559] gitaly[911]: time="2026-09-14T08:38:14.018Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T08:38:24.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:38:14.011" grpc.time_ms=7.025 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963gitlab # [ 239.715848] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:14.021Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"7ac0a1c7b6c8c3001278d327","created_at":"2026-09-14T08:38:14.020Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-3fc7979eae8d4816","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"0ddbf41c5bdb9b811374e7f0","job_size_bytes":46,"pid":2503,"job_status":"deduplicated","message":"ProjectCacheWorker JID-7ac0a1c7b6c8c3001278d327: deduplicated: until executing","deduplication.type":"until executing"}1964gitlab # [ 239.761065] gitaly[911]: time="2026-09-14T08:38:14.038Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-14T08:38:24.019" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:14.029" grpc.time_ms=8.447 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1965gitlab # [ 239.761753] gitaly[911]: time="2026-09-14T08:38:14.046Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-14T08:38:44.040" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:14.041" grpc.time_ms=5.208 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 239.762401] gitaly[911]: time="2026-09-14T08:38:14.054Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=347 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-14T08:38:24.041" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-14T08:38:14.051" grpc.time_ms=2.94 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1967gitlab # [ 239.766618] gitaly[911]: time="2026-09-14T08:38:14.064Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:24.049" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:14.059" grpc.time_ms=4.672 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab # [ 239.811726] gitaly[911]: time="2026-09-14T08:38:14.116Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-14T08:38:24.105" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:14.115" grpc.time_ms=0.842 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 239.816995] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:14.127Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","00133f1f38ec45f9af780822105d5f6e8e8ff7e6 c3ed311f746d9e796bcb062f5c7ef32fcecb83ea refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2befa44f0b426706a04dee3e","created_at":"2026-09-14T08:38:11.706Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-57654ae99488488f","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:11.708Z","job_size_bytes":185,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2befa44f0b426706a04dee3e: done: 0.166838 sec","job_status":"done","queue_duration_s":2.252325,"scheduling_latency_s":2.252357,"gitaly_calls":7,"gitaly_duration_s":0.053714,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.01368,"redis_read_bytes":501,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.001493,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000525,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002115,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.004748,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.004799,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000608178,"exclusive_lock_hold_duration_s":0.022484701,"duration_s":0.166838,"completed_at":"2026-09-14T08:38:14.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014224,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1970gitlab # [ 239.835982] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:14.128Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0ddbf41c5bdb9b811374e7f0","created_at":"2026-09-14T08:38:12.753Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-1900646dcb204923","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:12.766Z","job_size_bytes":46,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0ddbf41c5bdb9b811374e7f0: start","job_status":"start","queue_duration_s":1.36188,"scheduling_latency_s":1.361896}1971gitlab # [ 239.884735] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:14.187Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0ddbf41c5bdb9b811374e7f0","created_at":"2026-09-14T08:38:12.753Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-1900646dcb204923","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:12.766Z","job_size_bytes":46,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0ddbf41c5bdb9b811374e7f0: done: 0.05898 sec","job_status":"done","queue_duration_s":1.36188,"scheduling_latency_s":1.361896,"gitaly_calls":2,"gitaly_duration_s":0.011583,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.004149,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000726,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000321,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001809,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192483,"duration_s":0.05898,"completed_at":"2026-09-14T08:38:14.187Z","load_balancing_strategy":"primary","db_duration_s":0.007934,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1972gitlab # [ 239.927646] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:14.188Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"93428a693ba3b831a25c3492","created_at":"2026-09-14T08:38:12.778Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-1900646dcb204923","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:12.781Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-93428a693ba3b831a25c3492: start","job_status":"start","queue_duration_s":1.406538,"scheduling_latency_s":1.406552}1973gitlab # [ 239.928563] gitaly[911]: time="2026-09-14T08:38:14.157Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-14T14:38:14.154" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:38:14.154" grpc.time_ms=2.235 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab # [ 239.929479] gitaly[911]: time="2026-09-14T08:38:14.169Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-14T08:38:44.163" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:14.163" grpc.time_ms=5.946 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab # [ 239.930471] gitaly[911]: time="2026-09-14T08:38:14.223Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 diskcache=e97be941-9a9a-4013-9ddb-704fda41aa61 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-14T14:38:14.201" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:14.201" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab # [ 239.939435] gitaly[911]: time="2026-09-14T08:38:14.223Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1289 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-14T14:38:14.201" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:14.201" grpc.time_ms=21.632 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1977gitlab # [ 239.983167] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:14.247Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"93428a693ba3b831a25c3492","created_at":"2026-09-14T08:38:12.778Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-1900646dcb204923","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:12.781Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-93428a693ba3b831a25c3492: done: 0.059648 sec","job_status":"done","queue_duration_s":1.406538,"scheduling_latency_s":1.406552,"gitaly_calls":1,"gitaly_duration_s":0.023312,"redis_calls":15,"redis_duration_s":0.002082,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000337,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000755,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.044390278,"duration_s":0.059648,"completed_at":"2026-09-14T08:38:14.247Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009379,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1978gitlab # [ 239.994335] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:14.248Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"27b58fdb2e8ee273c0cb305c","created_at":"2026-09-14T08:38:12.911Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-1900646dcb204923","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:12.913Z","job_size_bytes":23,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-27b58fdb2e8ee273c0cb305c: start","job_status":"start","queue_duration_s":1.335808,"scheduling_latency_s":1.335822}1979gitlab # [ 240.039658] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:14.308Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"27b58fdb2e8ee273c0cb305c","created_at":"2026-09-14T08:38:12.911Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-1900646dcb204923","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:12.913Z","job_size_bytes":23,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-27b58fdb2e8ee273c0cb305c: done: 0.059596 sec","job_status":"done","queue_duration_s":1.335808,"scheduling_latency_s":1.335822,"gitaly_calls":1,"gitaly_duration_s":0.007992,"redis_calls":16,"redis_duration_s":0.029148,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000935,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002565,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.024164,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059596,"completed_at":"2026-09-14T08:38:14.308Z","load_balancing_strategy":"primary","db_duration_s":0.002031,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1980gitlab # [ 240.077728] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:14.311Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"55060d28c0ecddb38ea10751","created_at":"2026-09-14T08:38:13.269Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-1900646dcb204923","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:be55c39a9f1068540cafa795eb4ce58c4ba954fd9cd16545a782ccb51e23b600","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.273Z","job_size_bytes":467,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-55060d28c0ecddb38ea10751: start","job_status":"start","queue_duration_s":1.038703,"scheduling_latency_s":1.038722}1981gitlab # [ 240.078540] gitaly[911]: time="2026-09-14T08:38:14.297Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-14T08:38:44.291" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:14.291" grpc.time_ms=5.959 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab # [ 240.079200] gitaly[911]: time="2026-09-14T08:38:14.377Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:44.376" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:14.377" grpc.time_ms=0.513 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 240.119833] gitaly[911]: time="2026-09-14T08:38:14.384Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-14T08:38:24.009" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:14.379" grpc.time_ms=4.843 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 240.203375] gitaly[911]: time="2026-09-14T08:38:14.513Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T08:38:44.511" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:14.512" grpc.time_ms=1.1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab # [ 240.211514] gitaly[911]: time="2026-09-14T08:38:14.521Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=27 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-14T08:38:44.518" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:14.519" grpc.time_ms=2.534 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1986gitlab # [ 240.299573] gitaly[911]: time="2026-09-14T08:38:14.609Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:24.230" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:14.600" grpc.time_ms=8.986 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1987gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea'1988gitlab # [ 240.712634] gitaly[911]: time="2026-09-14T08:38:15.022Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-14T08:38:45.003" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:15.003" grpc.time_ms=18.477 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1989gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', in 0.04 seconds)1990gitlab # [ 240.766160] gitaly[911]: time="2026-09-14T08:38:15.076Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH0S2G2V0XQZZSFQQD7959 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-14T08:38:45.058" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:15.059" grpc.time_ms=16.914 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab # [ 240.767587] nixbot[2628]: INFO: ::ffff:127.0.0.1:36960 - "GET /api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 200 OK1992gitlab # [ 240.833201] sidekiq-cluster[2503]: {"severity":"WARN","time":"2026-09-14T08:38:15.142Z","class":"CreatePipelineWorker","correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"00133f1f38ec45f9af780822105d5f6e8e8ff7e6","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"00133f1f38ec45f9af780822105d5f6e8e8ff7e6","ref":"refs/heads/master"},"retry":0}1993gitlab # [ 240.842779] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"55060d28c0ecddb38ea10751","created_at":"2026-09-14T08:38:13.269Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-1900646dcb204923","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:be55c39a9f1068540cafa795eb4ce58c4ba954fd9cd16545a782ccb51e23b600","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.273Z","job_size_bytes":467,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-55060d28c0ecddb38ea10751: done: 0.840241 sec","job_status":"done","queue_duration_s":1.038703,"scheduling_latency_s":1.038722,"gitaly_calls":7,"gitaly_duration_s":0.133794,"redis_calls":51,"redis_duration_s":0.009467,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.000738,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003797,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002384,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.61909,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000564876,"duration_s":0.840241,"completed_at":"2026-09-14T08:38:15.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047095,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1994gitlab # [ 240.909872] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.154Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"9e52b93a-99c3-4e09-a202-2bdd985dd789\"}"],"class":"WebHookWorker","jid":"36d6e53ff9290ed8d85a1c5d","created_at":"2026-09-14T08:38:13.352Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-1900646dcb204923","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:30bf90d4eb716b52f9e49871d9ed910a78a53ef0fd92942d7ed8ba7812cc4851","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.356Z","job_size_bytes":1751,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-36d6e53ff9290ed8d85a1c5d: start","job_status":"start","queue_duration_s":1.797961,"scheduling_latency_s":1.797986}1995gitlab # [ 240.966743] nixbot[2628]: INFO: ::ffff:127.0.0.1:36970 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1996gitlab # [ 240.990426] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.299Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"9e52b93a-99c3-4e09-a202-2bdd985dd789\"}"],"class":"WebHookWorker","jid":"36d6e53ff9290ed8d85a1c5d","created_at":"2026-09-14T08:38:13.352Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-1900646dcb204923","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:30bf90d4eb716b52f9e49871d9ed910a78a53ef0fd92942d7ed8ba7812cc4851","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.356Z","job_size_bytes":1751,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-36d6e53ff9290ed8d85a1c5d: done: 0.144679 sec","job_status":"done","queue_duration_s":1.797961,"scheduling_latency_s":1.797986,"redis_calls":19,"redis_duration_s":0.005111,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001195,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000573,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002077,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001266,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.056530369000000746,"cpu_s":0.071993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000687517,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.144679,"completed_at":"2026-09-14T08:38:15.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 241.047068] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.357Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c01e4a5e6e26869c659ffe70","created_at":"2026-09-14T08:38:13.668Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.670Z","job_size_bytes":23,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c01e4a5e6e26869c659ffe70: start","job_status":"start","queue_duration_s":1.686139,"scheduling_latency_s":1.686185}1998gitlab # [ 241.066672] gitaly[911]: time="2026-09-14T08:38:15.377Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH28GCAX8B0BC8Z1AN0PJ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:15.366" grpc.time_ms=9.957 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1999gitlab # [ 241.079052] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:15 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 692000gitlab # [ 241.136692] gitaly[911]: time="2026-09-14T08:38:15.447Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH28JMW0M3E958V049T8NJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:15.437" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2001gitlab # [ 241.149276] gitaly[911]: time="2026-09-14T08:38:15.447Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH28JMW0M3E958V049T8NJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:15.437" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2002gitlab # [ 241.161859] gitlab-workhorse[829]: time="2026-09-14T08:38:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672003gitlab # [ 241.162213] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:15 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 682004gitlab # [ 241.162658] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.471Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c01e4a5e6e26869c659ffe70","created_at":"2026-09-14T08:38:13.668Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.670Z","job_size_bytes":23,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c01e4a5e6e26869c659ffe70: done: 0.114613 sec","job_status":"done","queue_duration_s":1.686139,"scheduling_latency_s":1.686185,"redis_calls":10,"redis_duration_s":0.024677,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.014887,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00935,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000258971,"duration_s":0.114613,"completed_at":"2026-09-14T08:38:15.471Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016208,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2005gitlab # [ 241.165177] gitaly[911]: time="2026-09-14T08:38:15.447Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH28JMW0M3E958V049T8NJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:15.437" grpc.time_ms=9.512 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2006gitlab # [ 241.213791] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.474Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bad19c279471fc04dd72d883","created_at":"2026-09-14T08:38:13.820Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.823Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bad19c279471fc04dd72d883: start","job_status":"start","queue_duration_s":1.650321,"scheduling_latency_s":1.650347}2007gitlab # [ 241.214653] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.502Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bad19c279471fc04dd72d883","created_at":"2026-09-14T08:38:13.820Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.823Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bad19c279471fc04dd72d883: done: 0.028138 sec","job_status":"done","queue_duration_s":1.650321,"scheduling_latency_s":1.650347,"redis_calls":10,"redis_duration_s":0.0033970000000000003,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000837,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000245004,"duration_s":0.028138,"completed_at":"2026-09-14T08:38:15.502Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2008gitlab # [ 241.262405] gitaly[911]: time="2026-09-14T08:38:15.564Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH28MTKXBK4D82T4NKTQA8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:15.494" pid=911 remote_ip="2001:db8:1::1" request_sha=c9508921e9f4886d28800b36bc7534d411892f15 response_bytes=336 span.kind=server system=grpc2009gitlab # [ 241.262982] gitlab-workhorse[829]: time="2026-09-14T08:38:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3362010gitlab # [ 241.263595] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:15 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 1152011gitlab # [ 241.264130] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.503Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"27b288bd0fdee38cfbfdae01","created_at":"2026-09-14T08:38:13.832Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.836Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-27b288bd0fdee38cfbfdae01: start","job_status":"start","queue_duration_s":1.667055,"scheduling_latency_s":1.667068}2012gitlab # [ 241.264703] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.524Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"27b288bd0fdee38cfbfdae01","created_at":"2026-09-14T08:38:13.832Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.836Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-27b288bd0fdee38cfbfdae01: done: 0.020757 sec","job_status":"done","queue_duration_s":1.667055,"scheduling_latency_s":1.667068,"redis_calls":10,"redis_duration_s":0.001304,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196114,"duration_s":0.020757,"completed_at":"2026-09-14T08:38:15.523Z","load_balancing_strategy":"primary","db_duration_s":0.002987,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2013gitlab # [ 241.305326] gitaly[911]: time="2026-09-14T08:38:15.565Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1188 command.oublock=0 command.real_time_ms=67 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH28MTKXBK4D82T4NKTQA8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:15.494" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2014gitlab # [ 241.311115] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.527Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"22963e14587a26f523896fff","created_at":"2026-09-14T08:38:13.844Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.846Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-22963e14587a26f523896fff: start","job_status":"start","queue_duration_s":1.680788,"scheduling_latency_s":1.680801}2015gitlab # [ 241.325250] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.550Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"22963e14587a26f523896fff","created_at":"2026-09-14T08:38:13.844Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.846Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-22963e14587a26f523896fff: done: 0.023433 sec","job_status":"done","queue_duration_s":1.680788,"scheduling_latency_s":1.680801,"redis_calls":13,"redis_duration_s":0.001914,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000379,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196394,"duration_s":0.023433,"completed_at":"2026-09-14T08:38:15.550Z","load_balancing_strategy":"primary","db_duration_s":0.004166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016gitlab # [ 241.366360] gitaly[911]: time="2026-09-14T08:38:15.565Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1188 command.oublock=0 command.real_time_ms=67 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH28MTKXBK4D82T4NKTQA8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:15.494" grpc.time_ms=70.934 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2017gitlab # [ 241.379952] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.551Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2a474cf157469248b53c1e35","created_at":"2026-09-14T08:38:13.846Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.849Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2a474cf157469248b53c1e35: start","job_status":"start","queue_duration_s":1.702371,"scheduling_latency_s":1.702384}2018gitlab # [ 241.421228] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.574Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2a474cf157469248b53c1e35","created_at":"2026-09-14T08:38:13.846Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.849Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2a474cf157469248b53c1e35: done: 0.023265 sec","job_status":"done","queue_duration_s":1.702371,"scheduling_latency_s":1.702384,"redis_calls":10,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00024,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257574,"duration_s":0.023265,"completed_at":"2026-09-14T08:38:15.574Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003366,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2019gitlab # [ 241.462827] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.576Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"5ad88333da0f61a9526c431e","created_at":"2026-09-14T08:38:13.849Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.852Z","job_size_bytes":19,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-5ad88333da0f61a9526c431e: start","job_status":"start","queue_duration_s":1.7248,"scheduling_latency_s":1.72483}2020gitlab # [ 241.463255] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.598Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"5ad88333da0f61a9526c431e","created_at":"2026-09-14T08:38:13.849Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.852Z","job_size_bytes":19,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-5ad88333da0f61a9526c431e: done: 0.021561 sec","job_status":"done","queue_duration_s":1.7248,"scheduling_latency_s":1.72483,"redis_calls":11,"redis_duration_s":0.001361,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000199467,"duration_s":0.021561,"completed_at":"2026-09-14T08:38:15.598Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021gitlab # [ 241.516672] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.599Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"37d175b13811b84d78d14c92","created_at":"2026-09-14T08:38:13.853Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.855Z","job_size_bytes":66,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-37d175b13811b84d78d14c92: start","job_status":"start","queue_duration_s":1.743283,"scheduling_latency_s":1.743296}2022gitlab # [ 241.517448] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.617Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"37d175b13811b84d78d14c92","created_at":"2026-09-14T08:38:13.853Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.855Z","job_size_bytes":66,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-37d175b13811b84d78d14c92: done: 0.018687 sec","job_status":"done","queue_duration_s":1.743283,"scheduling_latency_s":1.743296,"redis_calls":10,"redis_duration_s":0.0011719999999999999,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000224,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189968,"duration_s":0.018687,"completed_at":"2026-09-14T08:38:15.617Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2023gitlab # [ 241.574134] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.618Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"353e33604f4e25fa340e9071","created_at":"2026-09-14T08:38:13.856Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.858Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-353e33604f4e25fa340e9071: start","job_status":"start","queue_duration_s":1.759979,"scheduling_latency_s":1.759992}2024gitlab # [ 241.574760] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.642Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"353e33604f4e25fa340e9071","created_at":"2026-09-14T08:38:13.856Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.858Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-353e33604f4e25fa340e9071: done: 0.023319 sec","job_status":"done","queue_duration_s":1.759979,"scheduling_latency_s":1.759992,"redis_calls":10,"redis_duration_s":0.0012209999999999999,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000190806,"duration_s":0.023319,"completed_at":"2026-09-14T08:38:15.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 241.596277] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.642Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5a5091cd772ae3cc01e7fa91","created_at":"2026-09-14T08:38:13.862Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.864Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5a5091cd772ae3cc01e7fa91: start","job_status":"start","queue_duration_s":1.778597,"scheduling_latency_s":1.77861}2026gitlab # [ 241.639139] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.664Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5a5091cd772ae3cc01e7fa91","created_at":"2026-09-14T08:38:13.862Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.864Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5a5091cd772ae3cc01e7fa91: done: 0.02186 sec","job_status":"done","queue_duration_s":1.778597,"scheduling_latency_s":1.77861,"redis_calls":10,"redis_duration_s":0.001392,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00023,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193041,"duration_s":0.02186,"completed_at":"2026-09-14T08:38:15.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2027gitlab # [ 241.688717] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.665Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6e9954076fbdce3e69fe25e1","created_at":"2026-09-14T08:38:13.864Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.867Z","job_size_bytes":6,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6e9954076fbdce3e69fe25e1: start","job_status":"start","queue_duration_s":1.798215,"scheduling_latency_s":1.798228}2028gitlab # [ 241.689481] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6e9954076fbdce3e69fe25e1","created_at":"2026-09-14T08:38:13.864Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.867Z","job_size_bytes":6,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6e9954076fbdce3e69fe25e1: done: 0.012807 sec","job_status":"done","queue_duration_s":1.798215,"scheduling_latency_s":1.798228,"redis_calls":10,"redis_duration_s":0.001211,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193321,"duration_s":0.012807,"completed_at":"2026-09-14T08:38:15.678Z","load_balancing_strategy":"primary","db_duration_s":0.001237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2029gitlab # [ 241.736616] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.679Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"118b9b4c4edcc1c9ef741bbf","created_at":"2026-09-14T08:38:13.867Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.870Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-118b9b4c4edcc1c9ef741bbf: start","job_status":"start","queue_duration_s":1.809027,"scheduling_latency_s":1.80904}2030gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea'2031gitlab # [ 241.737414] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"118b9b4c4edcc1c9ef741bbf","created_at":"2026-09-14T08:38:13.867Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.870Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-118b9b4c4edcc1c9ef741bbf: done: 0.020003 sec","job_status":"done","queue_duration_s":1.809027,"scheduling_latency_s":1.80904,"redis_calls":10,"redis_duration_s":0.00124,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000187175,"duration_s":0.020003,"completed_at":"2026-09-14T08:38:15.699Z","load_balancing_strategy":"primary","db_duration_s":0.003455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2032gitlab # [ 241.778342] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.700Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"85110b6100a722572fbff857","created_at":"2026-09-14T08:38:13.873Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.875Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-85110b6100a722572fbff857: start","job_status":"start","queue_duration_s":1.824107,"scheduling_latency_s":1.824121}2033gitlab # [ 241.778911] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.740Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"85110b6100a722572fbff857","created_at":"2026-09-14T08:38:13.873Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.875Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-85110b6100a722572fbff857: done: 0.040202 sec","job_status":"done","queue_duration_s":1.824107,"scheduling_latency_s":1.824121,"redis_calls":14,"redis_duration_s":0.002339,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000847,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000254222,"duration_s":0.040202,"completed_at":"2026-09-14T08:38:15.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2034gitlab # [ 241.842189] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.741Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5759cfbc0f2b1d6b4d373ab7","created_at":"2026-09-14T08:38:13.946Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.948Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5759cfbc0f2b1d6b4d373ab7: start","job_status":"start","queue_duration_s":1.793146,"scheduling_latency_s":1.793159}2035gitlab # [ 241.842815] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.758Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5759cfbc0f2b1d6b4d373ab7","created_at":"2026-09-14T08:38:13.946Z","trace_propagation_headers":{"sentry-trace":"ae0bb92d5881401d818fa08f0d937a00-4b10025a5f784a59","baggage":"sentry-trace_id=ae0bb92d5881401d818fa08f0d937a00,sentry-release=Unknown"},"correlation_id":"01M2FH0XSKC0RPM85381TVP5Z7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:13.948Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5759cfbc0f2b1d6b4d373ab7: done: 0.017374 sec","job_status":"done","queue_duration_s":1.793146,"scheduling_latency_s":1.793159,"redis_calls":8,"redis_duration_s":0.001033,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017374,"completed_at":"2026-09-14T08:38:15.758Z","load_balancing_strategy":"primary","db_duration_s":0.002701,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2036gitlab # [ 241.856709] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:15.759Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"2cff20621998f3fdea574b6c","created_at":"2026-09-14T08:38:14.025Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-3fc7979eae8d4816","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"93428a693ba3b831a25c3492","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:14.027Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-2cff20621998f3fdea574b6c: start","job_status":"start","queue_duration_s":1.732295,"scheduling_latency_s":1.732308}2037gitlab # [ 241.918483] gitaly[911]: time="2026-09-14T08:38:16.228Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH diskcache=90f9b149-70ef-433b-9c30-57d1fa62871a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-14T14:38:15.769" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:15.770" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 241.918854] gitaly[911]: time="2026-09-14T08:38:16.228Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-14T14:38:15.769" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:15.770" grpc.time_ms=458.739 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2039gitlab # [ 241.932282] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:16.242Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"2cff20621998f3fdea574b6c","created_at":"2026-09-14T08:38:14.025Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-3fc7979eae8d4816","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"93428a693ba3b831a25c3492","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:14.027Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-2cff20621998f3fdea574b6c: done: 0.482865 sec","job_status":"done","queue_duration_s":1.732295,"scheduling_latency_s":1.732308,"gitaly_calls":1,"gitaly_duration_s":0.460742,"redis_calls":12,"redis_duration_s":0.0025960000000000002,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000333,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001502,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.470684403,"duration_s":0.482865,"completed_at":"2026-09-14T08:38:16.242Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2040gitlab # [ 241.977290] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:16.243Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a81555c3cec907af3712b5ee","created_at":"2026-09-14T08:38:14.097Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-3fc7979eae8d4816","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:27608b948c695b4d5ad5fad09afce6af97be88211b87d489a9be2e9254c09fe4","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:14.099Z","job_size_bytes":467,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a81555c3cec907af3712b5ee: start","job_status":"start","queue_duration_s":2.144702,"scheduling_latency_s":2.144717}2041gitlab # [ 241.977980] gitaly[911]: time="2026-09-14T08:38:16.260Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:46.259" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:16.259" grpc.time_ms=0.548 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 241.978920] nixbot[2628]: {"ts": "2026-09-14T08:38:16.253Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2043gitlab # [ 242.014248] gitaly[911]: time="2026-09-14T08:38:16.324Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=59 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-14T08:38:26.253" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:16.263" grpc.time_ms=60.836 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2044gitlab # [ 242.017958] nixbot[2628]: INFO: ::ffff:127.0.0.1:36972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 200 OK2045gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', in 0.26 seconds)2046gitlab # [ 242.029273] gitaly[911]: time="2026-09-14T08:38:16.338Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH29E6C4PJCF0BRARE32QK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:46.037" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:16.338" grpc.time_ms=0.748 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047gitlab # [ 242.052871] gitaly[911]: time="2026-09-14T08:38:16.363Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T08:38:46.362" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:16.362" grpc.time_ms=0.587 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048gitlab # [ 242.064676] gitaly[911]: time="2026-09-14T08:38:16.371Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=325 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-14T08:38:46.366" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:16.366" grpc.time_ms=4.211 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049gitlab # [ 242.079261] gitaly[911]: time="2026-09-14T08:38:16.375Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH29E6C4PJCF0BRARE32QK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:26.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:16.371" grpc.time_ms=4.186 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2050gitlab # [ 242.099038] gitaly[911]: time="2026-09-14T08:38:16.409Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:26.034" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:16.404" grpc.time_ms=5.099 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 242.104392] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1512052gitlab # [ 242.105263] nixbot[2628]: {"ts": "2026-09-14T08:38:16.415Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 \"HTTP/1.1 201 Created\""}2053gitlab # [ 242.145347] gitaly[911]: time="2026-09-14T08:38:16.455Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH29K18YQCZR9B2B057E5N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:46.154" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:16.455" grpc.time_ms=0.515 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 242.183590] gitaly[911]: time="2026-09-14T08:38:16.494Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH29K18YQCZR9B2B057E5N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:26.168" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:16.488" grpc.time_ms=5.037 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 242.222311] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1142056gitlab # [ 242.223232] nixbot[2628]: {"ts": "2026-09-14T08:38:16.533Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 \"HTTP/1.1 201 Created\""}2057gitlab # [ 242.261091] gitaly[911]: time="2026-09-14T08:38:16.571Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH29PS7NHS5ERSM5MV56T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:46.069" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:16.570" grpc.time_ms=0.921 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab # [ 242.299364] gitaly[911]: time="2026-09-14T08:38:16.609Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH29PS7NHS5ERSM5MV56T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:26.278" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:16.599" grpc.time_ms=10.22 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 242.349363] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1212060gitlab # [ 242.350127] nixbot[2628]: {"ts": "2026-09-14T08:38:16.660Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00133f1f38ec45f9af780822105d5f6e8e8ff7e6 \"HTTP/1.1 201 Created\""}2061gitlab # [ 242.431379] gitaly[911]: time="2026-09-14T08:38:16.741Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2FH29VVM1XB59T1W97PG444 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:16.731" grpc.time_ms=10.156 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2062gitlab # [ 242.432071] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 432063gitlab # [ 242.466117] gitaly[911]: time="2026-09-14T08:38:16.776Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-14T08:38:46.764" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:16.764" grpc.time_ms=11.847 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2064gitlab # [ 242.503638] gitaly[911]: time="2026-09-14T08:38:16.814Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH24GNMT4NYEZ1DVSW2HTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-14T08:38:46.801" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:16.801" grpc.time_ms=12.148 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 242.513196] sidekiq-cluster[2503]: {"severity":"WARN","time":"2026-09-14T08:38:16.823Z","class":"CreatePipelineWorker","correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"00133f1f38ec45f9af780822105d5f6e8e8ff7e6","after":"c3ed311f746d9e796bcb062f5c7ef32fcecb83ea","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"c3ed311f746d9e796bcb062f5c7ef32fcecb83ea","ref":"refs/heads/master"},"retry":0}2066gitlab # [ 242.518921] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:16.829Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a81555c3cec907af3712b5ee","created_at":"2026-09-14T08:38:14.097Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-3fc7979eae8d4816","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:27608b948c695b4d5ad5fad09afce6af97be88211b87d489a9be2e9254c09fe4","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:14.099Z","job_size_bytes":467,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a81555c3cec907af3712b5ee: done: 0.58526 sec","job_status":"done","queue_duration_s":2.144702,"scheduling_latency_s":2.144717,"gitaly_calls":7,"gitaly_duration_s":0.176471,"redis_calls":33,"redis_duration_s":0.006002,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000377,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003419,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000835,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.38912,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.58526,"completed_at":"2026-09-14T08:38:16.829Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014242,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2067gitlab # [ 242.525352] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:16.835Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"67666900-06da-47ad-96c8-5ce224eee2f5\"}"],"class":"WebHookWorker","jid":"3f8f17b8ae7edb15b8fab6f9","created_at":"2026-09-14T08:38:14.107Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-3fc7979eae8d4816","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1d16b2a6f22b0d2840bbb5804e727ef8365235a2d3ec4e223c59bcde70d7e83","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:14.108Z","job_size_bytes":1749,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3f8f17b8ae7edb15b8fab6f9: start","job_status":"start","queue_duration_s":2.726695,"scheduling_latency_s":2.726715}2068gitlab # [ 242.568052] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:16.864Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"67666900-06da-47ad-96c8-5ce224eee2f5\"}"],"class":"WebHookWorker","jid":"3f8f17b8ae7edb15b8fab6f9","created_at":"2026-09-14T08:38:14.107Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-3fc7979eae8d4816","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1d16b2a6f22b0d2840bbb5804e727ef8365235a2d3ec4e223c59bcde70d7e83","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:14.108Z","job_size_bytes":1749,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3f8f17b8ae7edb15b8fab6f9: done: 0.029269 sec","job_status":"done","queue_duration_s":2.726695,"scheduling_latency_s":2.726715,"redis_calls":14,"redis_duration_s":0.00226,"redis_read_bytes":25,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000417,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000801,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006172012999996923,"cpu_s":0.016078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.029269,"completed_at":"2026-09-14T08:38:16.864Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2069gitlab # [ 242.583871] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:16.865Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"62a520d1efb02c8f7c47db03","created_at":"2026-09-14T08:38:14.176Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-46dde3f2996444bb","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:14.179Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-62a520d1efb02c8f7c47db03: start","job_status":"start","queue_duration_s":2.685478,"scheduling_latency_s":2.685495}2070gitlab # [ 242.627420] nixbot[2628]: INFO: ::ffff:127.0.0.1:36976 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2071gitlab # [ 242.628164] gitaly[911]: time="2026-09-14T08:38:16.932Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH29Z13D7D9G7KE3GSZZ40 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:16.925" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2072gitlab # [ 242.628812] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:16.916Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"62a520d1efb02c8f7c47db03","created_at":"2026-09-14T08:38:14.176Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-46dde3f2996444bb","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:14.179Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-62a520d1efb02c8f7c47db03: done: 0.050936 sec","job_status":"done","queue_duration_s":2.685478,"scheduling_latency_s":2.685495,"redis_calls":19,"redis_duration_s":0.004382,"redis_read_bytes":21,"redis_write_bytes":4288,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00086,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000589,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2259,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001966,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00957496,"duration_s":0.050936,"completed_at":"2026-09-14T08:38:16.916Z","load_balancing_strategy":"primary","db_duration_s":0.019602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2073gitlab # [ 242.649621] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:16.917Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","36d6e53ff9290ed8d85a1c5d"],"class":"WebHooks::LogExecutionWorker","jid":"a88e8b65d7268a1220caf76b","created_at":"2026-09-14T08:38:15.280Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-472ab89cd8054294","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0d5fc2e06b543fcd4615de4c1c231e4ae579d5ebea41d1da28ae884d8591740e","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:15.287Z","job_size_bytes":2593,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a88e8b65d7268a1220caf76b: start","job_status":"start","queue_duration_s":1.630207,"scheduling_latency_s":1.630222}2074gitlab # [ 242.664873] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:16.952Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","36d6e53ff9290ed8d85a1c5d"],"class":"WebHooks::LogExecutionWorker","jid":"a88e8b65d7268a1220caf76b","created_at":"2026-09-14T08:38:15.280Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-472ab89cd8054294","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0d5fc2e06b543fcd4615de4c1c231e4ae579d5ebea41d1da28ae884d8591740e","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:15.287Z","job_size_bytes":2593,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a88e8b65d7268a1220caf76b: done: 0.035058 sec","job_status":"done","queue_duration_s":1.630207,"scheduling_latency_s":1.630222,"redis_calls":10,"redis_duration_s":0.001343,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021092,"duration_s":0.035058,"completed_at":"2026-09-14T08:38:16.952Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2075gitlab # [ 242.716034] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:16.953Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3741586fb83194cc5f50f7f3","created_at":"2026-09-14T08:38:16.401Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-cd6d3631cf01494b","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:16.404Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3741586fb83194cc5f50f7f3: start","job_status":"start","queue_duration_s":0.548823,"scheduling_latency_s":0.548837}2076gitlab # [ 242.718115] gitlab-workhorse[829]: time="2026-09-14T08:38:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672077gitlab # [ 242.719708] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1452078gitlab # [ 242.760706] gitaly[911]: time="2026-09-14T08:38:16.945Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH29Z13D7D9G7KE3GSZZ40 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:16.925" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2079gitlab # [ 242.761069] gitaly[911]: time="2026-09-14T08:38:16.946Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH29Z13D7D9G7KE3GSZZ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:16.925" grpc.time_ms=20.816 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2080gitlab # [ 242.787854] gitaly[911]: time="2026-09-14T08:38:17.098Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH29E6C4PJCF0BRARE32QK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:17.097" grpc.time_ms=0.866 pid=911 span.kind=server system=grpc2081gitlab # [ 242.806721] gitaly[911]: time="2026-09-14T08:38:17.117Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH29E6C4PJCF0BRARE32QK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:17.116" grpc.time_ms=0.226 pid=911 span.kind=server system=grpc2082gitlab # [ 242.834817] gitaly[911]: time="2026-09-14T08:38:17.145Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH29E6C4PJCF0BRARE32QK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:17.144" grpc.time_ms=0.515 pid=911 span.kind=server system=grpc2083gitlab # [ 242.850936] gitaly[911]: time="2026-09-14T08:38:17.161Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH29E6C4PJCF0BRARE32QK diskcache=6dc65bf9-ba0a-41f2-bbeb-969e9133f535 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:47.078" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:17.078" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 242.851775] gitaly[911]: time="2026-09-14T08:38:17.161Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=69 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7404 command.oublock=0 command.real_time_ms=75 command.spawn_token_fork_ms=0 command.system_time_ms=49 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH29E6C4PJCF0BRARE32QK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:47.078" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:17.078" grpc.time_ms=82.415 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 242.879166] gitaly[911]: time="2026-09-14T08:38:17.189Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=9 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2A9DN9AJKM47QN74ZF97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:17.173" grpc.time_ms=15.752 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2086gitlab # [ 242.879930] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:17 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 572087gitlab # [ 242.901263] gitaly[911]: time="2026-09-14T08:38:17.211Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH29E6C4PJCF0BRARE32QK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T08:38:47.210" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:17.210" grpc.time_ms=0.546 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 242.919265] gitaly[911]: time="2026-09-14T08:38:17.229Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH29E6C4PJCF0BRARE32QK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:47.228" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:17.228" grpc.time_ms=0.438 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089gitlab # [ 242.934825] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.244Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3741586fb83194cc5f50f7f3","created_at":"2026-09-14T08:38:16.401Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-cd6d3631cf01494b","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:16.404Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2503,"job_status":"rescheduled","message":"PipelineProcessWorker JID-3741586fb83194cc5f50f7f3: rescheduled"}2090gitlab # [ 242.939057] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.249Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3741586fb83194cc5f50f7f3","created_at":"2026-09-14T08:38:16.401Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-cd6d3631cf01494b","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:16.404Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3741586fb83194cc5f50f7f3: done: 0.295678 sec","job_status":"done","queue_duration_s":0.548823,"scheduling_latency_s":0.548837,"gitaly_calls":3,"gitaly_duration_s":0.089052,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.031184,"redis_read_bytes":148,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000493,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000587,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003931,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.013171,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000168,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000336,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.012005,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.076,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.076,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077175,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.261831602,"duration_s":0.295678,"completed_at":"2026-09-14T08:38:17.249Z","load_balancing_strategy":"primary","db_duration_s":0.102248,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2091gitlab # [ 242.987149] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.257Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3f8f17b8ae7edb15b8fab6f9"],"class":"WebHooks::LogExecutionWorker","jid":"1591e96613bc730482695050","created_at":"2026-09-14T08:38:16.857Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-bbe7bac84e464681","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ded383fabbe7392d19a6567f9142ef385d195341ca5d0872386304d0e363af1c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:16.859Z","job_size_bytes":2592,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1591e96613bc730482695050: start","job_status":"start","queue_duration_s":0.397624,"scheduling_latency_s":0.397641}2092gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea'2093gitlab # [ 242.987809] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.276Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3f8f17b8ae7edb15b8fab6f9"],"class":"WebHooks::LogExecutionWorker","jid":"1591e96613bc730482695050","created_at":"2026-09-14T08:38:16.857Z","trace_propagation_headers":{"sentry-trace":"de672c35b87648e08c5910c0fa6eca30-bbe7bac84e464681","baggage":"sentry-trace_id=de672c35b87648e08c5910c0fa6eca30,sentry-release=Unknown"},"correlation_id":"01M2FH24GNMT4NYEZ1DVSW2HTH","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ded383fabbe7392d19a6567f9142ef385d195341ca5d0872386304d0e363af1c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:16.859Z","job_size_bytes":2592,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1591e96613bc730482695050: done: 0.019037 sec","job_status":"done","queue_duration_s":0.397624,"scheduling_latency_s":0.397641,"redis_calls":7,"redis_duration_s":0.00105,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000319,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019037,"completed_at":"2026-09-14T08:38:17.276Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2094gitlab # [ 243.007575] gitlab-workhorse[829]: time="2026-09-14T08:38:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672095gitlab # [ 243.009074] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 692096gitlab # [ 243.010697] gitaly[911]: time="2026-09-14T08:38:17.260Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AB7BXB9KKQ0FQC5NFE5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:17.250" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2097gitlab # [ 243.050974] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.277Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"00b3b1f6adbef299c6294a83","created_at":"2026-09-14T08:38:16.902Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-348b35b721334574","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:16.909Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-00b3b1f6adbef299c6294a83: start","job_status":"start","queue_duration_s":0.368052,"scheduling_latency_s":0.368065}2098gitlab # [ 243.051632] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.330Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"00b3b1f6adbef299c6294a83","created_at":"2026-09-14T08:38:16.902Z","trace_propagation_headers":{"sentry-trace":"a622287e515b41d0adf3d0f9a2e32ad2-348b35b721334574","baggage":"sentry-trace_id=a622287e515b41d0adf3d0f9a2e32ad2,sentry-release=Unknown"},"correlation_id":"01M2FH0S2G2V0XQZZSFQQD7959","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:16.909Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-00b3b1f6adbef299c6294a83: done: 0.053498 sec","job_status":"done","queue_duration_s":0.368052,"scheduling_latency_s":0.368065,"redis_calls":11,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000317917,"duration_s":0.053498,"completed_at":"2026-09-14T08:38:17.330Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2099gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', in 0.08 seconds)2100gitlab # [ 243.091168] gitaly[911]: time="2026-09-14T08:38:17.260Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AB7BXB9KKQ0FQC5NFE5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:17.250" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2101gitlab # [ 243.091782] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.331Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"84a482074cd6ab7e31b70a32","created_at":"2026-09-14T08:38:17.073Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.075Z","job_size_bytes":23,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-84a482074cd6ab7e31b70a32: start","job_status":"start","queue_duration_s":0.256619,"scheduling_latency_s":0.256632}2102gitlab # [ 243.133360] gitaly[911]: time="2026-09-14T08:38:17.260Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AB7BXB9KKQ0FQC5NFE5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:17.250" grpc.time_ms=10.199 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2103gitlab # [ 243.134358] nixbot[2628]: INFO: ::ffff:127.0.0.1:57440 - "GET /api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 200 OK2104gitlab # [ 243.142046] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.452Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"84a482074cd6ab7e31b70a32","created_at":"2026-09-14T08:38:17.073Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.075Z","job_size_bytes":23,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-84a482074cd6ab7e31b70a32: done: 0.120697 sec","job_status":"done","queue_duration_s":0.256619,"scheduling_latency_s":0.256632,"redis_calls":7,"redis_duration_s":0.001044,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.095,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.120697,"completed_at":"2026-09-14T08:38:17.452Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.097787,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2105gitlab # [ 243.184758] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.457Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a6faf789520ea750d9fc68c2","created_at":"2026-09-14T08:38:17.168Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.170Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a6faf789520ea750d9fc68c2: start","job_status":"start","queue_duration_s":0.287176,"scheduling_latency_s":0.287195}2106gitlab # [ 243.185598] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.484Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a6faf789520ea750d9fc68c2","created_at":"2026-09-14T08:38:17.168Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.170Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a6faf789520ea750d9fc68c2: done: 0.026918 sec","job_status":"done","queue_duration_s":0.287176,"scheduling_latency_s":0.287195,"redis_calls":7,"redis_duration_s":0.001307,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026918,"completed_at":"2026-09-14T08:38:17.484Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2107gitlab # [ 243.227053] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:17 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 442108gitlab # [ 243.227791] gitaly[911]: time="2026-09-14T08:38:17.470Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2AJJWZ5VGDXGC5JEBBQM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:17.464" grpc.time_ms=5.391 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2109gitlab # [ 243.228517] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.485Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"3619ac374efd358bff0a04f4","created_at":"2026-09-14T08:38:17.175Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.176Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-3619ac374efd358bff0a04f4: start","job_status":"start","queue_duration_s":0.308872,"scheduling_latency_s":0.308892}2110gitlab # [ 243.233765] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.514Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"3619ac374efd358bff0a04f4","created_at":"2026-09-14T08:38:17.175Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.176Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-3619ac374efd358bff0a04f4: done: 0.028804 sec","job_status":"done","queue_duration_s":0.308872,"scheduling_latency_s":0.308892,"redis_calls":7,"redis_duration_s":0.003028,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00275,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028804,"completed_at":"2026-09-14T08:38:17.514Z","load_balancing_strategy":"primary","db_duration_s":0.006581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2111gitlab # [ 243.279043] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.515Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e186af383914120685a2a14e","created_at":"2026-09-14T08:38:17.181Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.182Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e186af383914120685a2a14e: start","job_status":"start","queue_duration_s":0.332178,"scheduling_latency_s":0.332193}2112gitlab # [ 243.320977] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.543Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e186af383914120685a2a14e","created_at":"2026-09-14T08:38:17.181Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.182Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e186af383914120685a2a14e: done: 0.028192 sec","job_status":"done","queue_duration_s":0.332178,"scheduling_latency_s":0.332193,"redis_calls":10,"redis_duration_s":0.005198,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0038,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001083,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028192,"completed_at":"2026-09-14T08:38:17.543Z","load_balancing_strategy":"primary","db_duration_s":0.003781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2113gitlab # [ 243.362447] gitaly[911]: time="2026-09-14T08:38:17.542Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AM0YN6CAZQHW8HAGRYQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:17.531" pid=911 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2114gitlab # [ 243.363142] gitlab-workhorse[829]: time="2026-09-14T08:38:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162115gitlab # [ 243.363525] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 712116gitlab # [ 243.364072] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.544Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"12b94c88fecba89fe789cfd6","created_at":"2026-09-14T08:38:17.184Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.184Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-12b94c88fecba89fe789cfd6: start","job_status":"start","queue_duration_s":0.359478,"scheduling_latency_s":0.359493}2117gitlab # [ 243.364697] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"12b94c88fecba89fe789cfd6","created_at":"2026-09-14T08:38:17.184Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.184Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-12b94c88fecba89fe789cfd6: done: 0.016484 sec","job_status":"done","queue_duration_s":0.359478,"scheduling_latency_s":0.359493,"redis_calls":7,"redis_duration_s":0.001039,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016484,"completed_at":"2026-09-14T08:38:17.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2118gitlab # [ 243.420732] gitaly[911]: time="2026-09-14T08:38:17.542Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AM0YN6CAZQHW8HAGRYQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:17.531" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2119gitlab # [ 243.421636] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.562Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d7b7ac0264917a7ba7a631bb","created_at":"2026-09-14T08:38:17.185Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.187Z","job_size_bytes":19,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d7b7ac0264917a7ba7a631bb: start","job_status":"start","queue_duration_s":0.374826,"scheduling_latency_s":0.374847}2120gitlab # [ 243.422425] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.578Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d7b7ac0264917a7ba7a631bb","created_at":"2026-09-14T08:38:17.185Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.187Z","job_size_bytes":19,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d7b7ac0264917a7ba7a631bb: done: 0.016544 sec","job_status":"done","queue_duration_s":0.374826,"scheduling_latency_s":0.374847,"redis_calls":8,"redis_duration_s":0.001111,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016544,"completed_at":"2026-09-14T08:38:17.578Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2121gitlab # [ 243.462235] gitaly[911]: time="2026-09-14T08:38:17.542Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AM0YN6CAZQHW8HAGRYQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:17.531" grpc.time_ms=11.082 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2122gitlab # [ 243.504083] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.579Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"90d8a066c648e462361be446","created_at":"2026-09-14T08:38:17.188Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.189Z","job_size_bytes":66,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-90d8a066c648e462361be446: start","job_status":"start","queue_duration_s":0.390473,"scheduling_latency_s":0.390492}2123gitlab # [ 243.504724] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.597Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"90d8a066c648e462361be446","created_at":"2026-09-14T08:38:17.188Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.189Z","job_size_bytes":66,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-90d8a066c648e462361be446: done: 0.018139 sec","job_status":"done","queue_duration_s":0.390473,"scheduling_latency_s":0.390492,"redis_calls":7,"redis_duration_s":0.000926,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018139,"completed_at":"2026-09-14T08:38:17.597Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124gitlab # [ 243.545430] nixbot[2628]: {"ts": "2026-09-14T08:38:17.780Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea \"HTTP/1.1 201 Created\""}2125gitlab # [ 243.545986] nixbot[2628]: {"ts": "2026-09-14T08:38:17.788Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-c3ed311f746d-5"}2126gitlab # [ 243.546606] gitaly[911]: time="2026-09-14T08:38:17.609Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:47.107" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:17.608" grpc.time_ms=0.943 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 243.547425] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 2082128gitlab # [ 243.547895] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.598Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2aed116e47c7a2133e1c052d","created_at":"2026-09-14T08:38:17.190Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.201Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2aed116e47c7a2133e1c052d: start","job_status":"start","queue_duration_s":0.397482,"scheduling_latency_s":0.397496}2129gitlab # [ 243.559973] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.615Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2aed116e47c7a2133e1c052d","created_at":"2026-09-14T08:38:17.190Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.201Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2aed116e47c7a2133e1c052d: done: 0.016902 sec","job_status":"done","queue_duration_s":0.397482,"scheduling_latency_s":0.397496,"redis_calls":7,"redis_duration_s":0.000972,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016902,"completed_at":"2026-09-14T08:38:17.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2130gitlab # [ 243.619409] gitaly[911]: time="2026-09-14T08:38:17.621Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-14T08:38:47.114" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:17.614" grpc.time_ms=6.535 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab # [ 243.620179] nixbot[2628]: {"ts": "2026-09-14T08:38:17.874Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-c3ed311f746d-5", "argv0": "bwrap"}2132gitlab # [ 243.620588] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"feb9c159dbd3880992a2cc48","created_at":"2026-09-14T08:38:17.201Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.202Z","job_size_bytes":6,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-feb9c159dbd3880992a2cc48: start","job_status":"start","queue_duration_s":0.4142,"scheduling_latency_s":0.414213}2133gitlab # [ 243.625049] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.625Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"feb9c159dbd3880992a2cc48","created_at":"2026-09-14T08:38:17.201Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.202Z","job_size_bytes":6,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-feb9c159dbd3880992a2cc48: done: 0.008628 sec","job_status":"done","queue_duration_s":0.4142,"scheduling_latency_s":0.414213,"redis_calls":7,"redis_duration_s":0.0009299999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008628,"completed_at":"2026-09-14T08:38:17.625Z","load_balancing_strategy":"primary","db_duration_s":0.000307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2134gitlab # [ 243.675739] gitaly[911]: time="2026-09-14T08:38:17.632Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:27.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:17.626" grpc.time_ms=6.818 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2135gitlab # [ 243.676578] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.626Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0dfec2d42c8f00e99c58a84b","created_at":"2026-09-14T08:38:17.202Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.203Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0dfec2d42c8f00e99c58a84b: start","job_status":"start","queue_duration_s":0.42256,"scheduling_latency_s":0.422572}2136gitlab # [ 243.687482] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.644Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0dfec2d42c8f00e99c58a84b","created_at":"2026-09-14T08:38:17.202Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.203Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0dfec2d42c8f00e99c58a84b: done: 0.018145 sec","job_status":"done","queue_duration_s":0.42256,"scheduling_latency_s":0.422572,"redis_calls":7,"redis_duration_s":0.001258,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018145,"completed_at":"2026-09-14T08:38:17.644Z","load_balancing_strategy":"primary","db_duration_s":0.002398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2137gitlab # [ 243.755952] gitaly[911]: time="2026-09-14T08:38:17.653Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-14T08:38:27.032" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:38:17.652" grpc.time_ms=0.22 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 243.756648] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.645Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5a23db8b876e1f2e39fd6698","created_at":"2026-09-14T08:38:17.245Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.246Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5a23db8b876e1f2e39fd6698: start","job_status":"start","queue_duration_s":0.399258,"scheduling_latency_s":0.399272}2139gitlab # [ 243.757424] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.663Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5a23db8b876e1f2e39fd6698","created_at":"2026-09-14T08:38:17.245Z","trace_propagation_headers":{"sentry-trace":"1291d5a6082c463781daa3b5f300f052-61ea646734974f84","baggage":"sentry-trace_id=1291d5a6082c463781daa3b5f300f052,sentry-release=Unknown"},"correlation_id":"01M2FH29E6C4PJCF0BRARE32QK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.246Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5a23db8b876e1f2e39fd6698: done: 0.01776 sec","job_status":"done","queue_duration_s":0.399258,"scheduling_latency_s":0.399272,"redis_calls":8,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01776,"completed_at":"2026-09-14T08:38:17.663Z","load_balancing_strategy":"primary","db_duration_s":0.002523,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2140gitlab # [ 243.785524] gitaly[911]: time="2026-09-14T08:38:17.663Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-14T08:38:27.036" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:17.656" grpc.time_ms=5.838 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 243.797553] gitaly[911]: time="2026-09-14T08:38:17.688Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:17.687" grpc.time_ms=0.331 pid=911 span.kind=server system=grpc2142gitlab # [ 243.805964] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.728Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1b03c36f159dfdd9a47cfcdc","created_at":"2026-09-14T08:38:17.724Z","trace_propagation_headers":{"sentry-trace":"e3a726ca998a44678073e09feb9d78d7-11e4500b37c64ec5","baggage":"sentry-trace_id=e3a726ca998a44678073e09feb9d78d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH2AQ377M81YH8GTTW6XT4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.727Z","job_size_bytes":65,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1b03c36f159dfdd9a47cfcdc: start","job_status":"start","queue_duration_s":0.001026,"scheduling_latency_s":0.001055}2143gitlab # [ 243.820784] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.755Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1b03c36f159dfdd9a47cfcdc","created_at":"2026-09-14T08:38:17.724Z","trace_propagation_headers":{"sentry-trace":"e3a726ca998a44678073e09feb9d78d7-11e4500b37c64ec5","baggage":"sentry-trace_id=e3a726ca998a44678073e09feb9d78d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH2AQ377M81YH8GTTW6XT4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.727Z","job_size_bytes":65,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1b03c36f159dfdd9a47cfcdc: done: 0.026955 sec","job_status":"done","queue_duration_s":0.001026,"scheduling_latency_s":0.001055,"redis_calls":7,"redis_duration_s":0.0030810000000000004,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001064,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002017,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026955,"completed_at":"2026-09-14T08:38:17.755Z","load_balancing_strategy":"primary","db_duration_s":0.003338,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2144gitlab # [ 243.860071] gitaly[911]: time="2026-09-14T08:38:17.706Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:17.705" grpc.time_ms=0.238 pid=911 span.kind=server system=grpc2145gitlab # [ 243.866756] gitaly[911]: time="2026-09-14T08:38:17.715Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 diskcache=5e8597d0-571f-45da-a8b9-bf040dbdab02 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T08:38:27.044" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:38:17.664" pid=911 ref=refs/keep-around/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea remote_ip="2001:db8:1::1" revision=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea span.kind=server system=grpc username=root2146gitlab # [ 243.877216] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.757Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0863045b64ec1eaabc224df8","created_at":"2026-09-14T08:38:17.728Z","trace_propagation_headers":{"sentry-trace":"e3a726ca998a44678073e09feb9d78d7-11e4500b37c64ec5","baggage":"sentry-trace_id=e3a726ca998a44678073e09feb9d78d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH2AQ377M81YH8GTTW6XT4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.729Z","job_size_bytes":65,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0863045b64ec1eaabc224df8: start","job_status":"start","queue_duration_s":0.027157,"scheduling_latency_s":0.027177}2147gitlab # [ 243.892603] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.794Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0863045b64ec1eaabc224df8","created_at":"2026-09-14T08:38:17.728Z","trace_propagation_headers":{"sentry-trace":"e3a726ca998a44678073e09feb9d78d7-11e4500b37c64ec5","baggage":"sentry-trace_id=e3a726ca998a44678073e09feb9d78d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH2AQ377M81YH8GTTW6XT4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.729Z","job_size_bytes":65,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0863045b64ec1eaabc224df8: done: 0.037742 sec","job_status":"done","queue_duration_s":0.027157,"scheduling_latency_s":0.027177,"redis_calls":10,"redis_duration_s":0.001376,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000668,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037742,"completed_at":"2026-09-14T08:38:17.794Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010954,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2148gitlab # [ 243.949136] gitaly[911]: time="2026-09-14T08:38:17.715Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=44 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5352 command.oublock=8 command.real_time_ms=44 command.spawn_token_fork_ms=0 command.system_time_ms=29 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T08:38:27.044" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T08:38:17.664" grpc.time_ms=50.805 pid=911 ref=refs/keep-around/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea remote_ip="2001:db8:1::1" revision=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea span.kind=server system=grpc username=root2149gitlab # [ 243.949990] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.796Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6f574f95ee7814dfb9fe6943","created_at":"2026-09-14T08:38:17.769Z","trace_propagation_headers":{"sentry-trace":"e3a726ca998a44678073e09feb9d78d7-11e4500b37c64ec5","baggage":"sentry-trace_id=e3a726ca998a44678073e09feb9d78d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH2AQ377M81YH8GTTW6XT4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.771Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6f574f95ee7814dfb9fe6943: start","job_status":"start","queue_duration_s":0.024517,"scheduling_latency_s":0.024535}2150gitlab # [ 243.958053] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.880Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6f574f95ee7814dfb9fe6943","created_at":"2026-09-14T08:38:17.769Z","trace_propagation_headers":{"sentry-trace":"e3a726ca998a44678073e09feb9d78d7-11e4500b37c64ec5","baggage":"sentry-trace_id=e3a726ca998a44678073e09feb9d78d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH2AQ377M81YH8GTTW6XT4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.771Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6f574f95ee7814dfb9fe6943: done: 0.084561 sec","job_status":"done","queue_duration_s":0.024517,"scheduling_latency_s":0.024535,"gitaly_calls":2,"gitaly_duration_s":0.00486,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.0048,"redis_read_bytes":79,"redis_write_bytes":5120,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000689,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000627,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000184,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1131,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000206,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000386,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057204,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.064491437,"duration_s":0.084561,"completed_at":"2026-09-14T08:38:17.880Z","load_balancing_strategy":"primary","db_duration_s":0.021185,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2151gitlab # [ 244.004602] gitaly[911]: time="2026-09-14T08:38:17.718Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:47.217" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:17.718" grpc.time_ms=0.297 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2152gitlab # [ 244.048587] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.881Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"021be0d3c5a26bbc5b945ce3","created_at":"2026-09-14T08:38:17.836Z","trace_propagation_headers":{"sentry-trace":"e3a726ca998a44678073e09feb9d78d7-84979f5241484305","baggage":"sentry-trace_id=e3a726ca998a44678073e09feb9d78d7,sentry-release=Unknown"},"correlation_id":"01M2FH2AQ377M81YH8GTTW6XT4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.837Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-021be0d3c5a26bbc5b945ce3: start","job_status":"start","queue_duration_s":0.043863,"scheduling_latency_s":0.043884}2153gitlab # [ 244.049408] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:17.904Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"021be0d3c5a26bbc5b945ce3","created_at":"2026-09-14T08:38:17.836Z","trace_propagation_headers":{"sentry-trace":"e3a726ca998a44678073e09feb9d78d7-84979f5241484305","baggage":"sentry-trace_id=e3a726ca998a44678073e09feb9d78d7,sentry-release=Unknown"},"correlation_id":"01M2FH2AQ377M81YH8GTTW6XT4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:17.837Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-021be0d3c5a26bbc5b945ce3: done: 0.022829 sec","job_status":"done","queue_duration_s":0.043863,"scheduling_latency_s":0.043884,"redis_calls":7,"redis_duration_s":0.000983,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022829,"completed_at":"2026-09-14T08:38:17.904Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2154gitlab # [ 244.066037] gitaly[911]: time="2026-09-14T08:38:17.848Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T08:38:47.847" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:17.847" grpc.time_ms=0.596 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea'2156gitlab # [ 244.108264] gitaly[911]: time="2026-09-14T08:38:17.872Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2AQ377M81YH8GTTW6XT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:47.871" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:17.872" grpc.time_ms=0.483 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 244.154972] nixbot[2628]: INFO: ::ffff:127.0.0.1:57448 - "GET /api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 200 OK2158gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', in 0.04 seconds)2159(finished: subtest: push delivers the webhook, in 48.02 seconds)2160subtest: eval and build post commit statuses2161gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses2162gitlab # [ 244.179863] nix-daemon[2785]: accepted connection from pid 3596, user nixbot2163gitlab # [ 244.209900] gitaly[911]: time="2026-09-14T08:38:18.520Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2BKKMS4KHZ1SNCAV0CKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:48.519" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:18.519" grpc.time_ms=0.707 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 244.229720] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 562165gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses, in 0.08 seconds)2166gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses2167gitlab # [ 245.354971] gitaly[911]: time="2026-09-14T08:38:19.664Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2CNT9GZX44XS9ASN5GPP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:49.662" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:19.663" grpc.time_ms=1.035 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 245.398371] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1292169gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses, in 0.17 seconds)2170gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses2171gitlab # [ 246.499795] gitaly[911]: time="2026-09-14T08:38:20.809Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2DTB8S11BBS25QSVAHWK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:50.807" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:20.808" grpc.time_ms=0.968 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 246.529746] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 922173gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses, in 0.13 seconds)2174gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses2175gitlab # [ 247.631131] gitaly[911]: time="2026-09-14T08:38:21.940Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2EXRD6JQ7MC93AS5QZPC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:51.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:21.939" grpc.time_ms=0.966 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 247.679699] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1082177gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses, in 0.15 seconds)2178gitlab # [ 248.223629] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:22.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a3fb9a69ea3be81220e07c8d","created_at":"2026-09-14T08:38:22.515Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e25a3f9acafce27646ff0d9d81d4003","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:22.530Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a3fb9a69ea3be81220e07c8d: start","job_status":"start","queue_duration_s":0.00284,"scheduling_latency_s":0.002877}2179gitlab # [ 248.344591] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:22.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a3fb9a69ea3be81220e07c8d","created_at":"2026-09-14T08:38:22.515Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e25a3f9acafce27646ff0d9d81d4003","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:22.530Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a3fb9a69ea3be81220e07c8d: done: 0.12152 sec","job_status":"done","queue_duration_s":0.00284,"scheduling_latency_s":0.002877,"redis_calls":9,"redis_duration_s":0.007391,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001774,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002546,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.12152,"completed_at":"2026-09-14T08:38:22.654Z","load_balancing_strategy":"primary","db_duration_s":0.038128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2180gitlab # [ 248.417863] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:22.727Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"6287f968120ee862080898eb","created_at":"2026-09-14T08:38:22.569Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7128e73fc2ba2cb94c78212163d52bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:22.584Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-6287f968120ee862080898eb: start","job_status":"start","queue_duration_s":0.143655,"scheduling_latency_s":0.143702}2181gitlab # [ 248.525291] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:22.834Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"6287f968120ee862080898eb","created_at":"2026-09-14T08:38:22.569Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7128e73fc2ba2cb94c78212163d52bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:22.584Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-6287f968120ee862080898eb: done: 0.10722 sec","job_status":"done","queue_duration_s":0.143655,"scheduling_latency_s":0.143702,"redis_calls":11,"redis_duration_s":0.039719,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004069,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.034595,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.10722,"completed_at":"2026-09-14T08:38:22.834Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2182gitlab # [ 248.600698] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:22.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ded18b02ca583e5ed51f2c17","created_at":"2026-09-14T08:38:22.616Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"704c0efbc6ce5d5bf69a751171b9a6d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T08:38:22.645Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ded18b02ca583e5ed51f2c17: start","job_status":"start","queue_duration_s":0.265425,"scheduling_latency_s":0.265456}2183gitlab # [ 248.634875] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:22.945Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2184gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses2185gitlab # [ 248.656725] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:22.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ded18b02ca583e5ed51f2c17","created_at":"2026-09-14T08:38:22.616Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"704c0efbc6ce5d5bf69a751171b9a6d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T08:38:22.645Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ded18b02ca583e5ed51f2c17: done: 0.055784 sec","job_status":"done","queue_duration_s":0.265425,"scheduling_latency_s":0.265456,"redis_calls":9,"redis_duration_s":0.014616,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004828,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055784,"completed_at":"2026-09-14T08:38:22.966Z","load_balancing_strategy":"primary","db_duration_s":0.001695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2186gitlab # [ 248.659886] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:22.970Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3905ad764a27561c713809f8","created_at":"2026-09-14T08:38:22.725Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b6efc96a3bc0e1dc303104ab2f92f70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:22.751Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3905ad764a27561c713809f8: start","job_status":"start","queue_duration_s":0.218915,"scheduling_latency_s":0.218951}2187gitlab # [ 248.703736] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3905ad764a27561c713809f8","created_at":"2026-09-14T08:38:22.725Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b6efc96a3bc0e1dc303104ab2f92f70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:22.751Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3905ad764a27561c713809f8: done: 0.043672 sec","job_status":"done","queue_duration_s":0.218915,"scheduling_latency_s":0.218951,"redis_calls":18,"redis_duration_s":0.005065,"redis_read_bytes":19,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001162,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000334,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002706,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000863,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043672,"completed_at":"2026-09-14T08:38:23.013Z","load_balancing_strategy":"primary","db_duration_s":0.003078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2188gitlab # [ 248.705794] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6d816934fd005a82a1ee3ba1","created_at":"2026-09-14T08:38:22.796Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b0d74cca7db10222f959a3b33bb1e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:22.812Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6d816934fd005a82a1ee3ba1: start","job_status":"start","queue_duration_s":0.203071,"scheduling_latency_s":0.203098}2189gitlab # [ 248.753149] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.039Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6d816934fd005a82a1ee3ba1","created_at":"2026-09-14T08:38:22.796Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b0d74cca7db10222f959a3b33bb1e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:22.812Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6d816934fd005a82a1ee3ba1: done: 0.023829 sec","job_status":"done","queue_duration_s":0.203071,"scheduling_latency_s":0.203098,"redis_calls":9,"redis_duration_s":0.002288,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023829,"completed_at":"2026-09-14T08:38:23.039Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006178,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2190gitlab # [ 248.758250] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"75ad2d1dcee1581bf0805496","created_at":"2026-09-14T08:38:22.824Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d785f2e15cd251886099dc603806d605","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:22.913Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-75ad2d1dcee1581bf0805496: start","job_status":"start","queue_duration_s":0.127811,"scheduling_latency_s":0.127825}2191gitlab # [ 248.849677] gitaly[911]: time="2026-09-14T08:38:23.159Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2G4FSYBDJBBSXWJPRP4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:53.057" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:23.158" grpc.time_ms=0.528 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses, in 0.19 seconds)2193gitlab # [ 248.860878] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.171Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"75ad2d1dcee1581bf0805496","created_at":"2026-09-14T08:38:22.824Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d785f2e15cd251886099dc603806d605","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:22.913Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-75ad2d1dcee1581bf0805496: done: 0.130294 sec","job_status":"done","queue_duration_s":0.127811,"scheduling_latency_s":0.127825,"redis_calls":11,"redis_duration_s":0.004364,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000671,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002458,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001235,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.082,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.082,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001088127,"exclusive_lock_hold_duration_s":0.037009731,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.130294,"completed_at":"2026-09-14T08:38:23.171Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08842,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2194gitlab # [ 248.861774] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"22b82aff7659011c44017c3d","created_at":"2026-09-14T08:38:22.934Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dadf6aae732030480f6e411a33ee8a8c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T08:38:22.946Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-22b82aff7659011c44017c3d: start","job_status":"start","queue_duration_s":0.22538,"scheduling_latency_s":0.225394}2195gitlab # [ 248.874721] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 642196gitlab # [ 248.905357] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"22b82aff7659011c44017c3d","created_at":"2026-09-14T08:38:22.934Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dadf6aae732030480f6e411a33ee8a8c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T08:38:22.946Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-22b82aff7659011c44017c3d: done: 0.043238 sec","job_status":"done","queue_duration_s":0.22538,"scheduling_latency_s":0.225394,"redis_calls":9,"redis_duration_s":0.003401,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002384,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043238,"completed_at":"2026-09-14T08:38:23.215Z","load_balancing_strategy":"primary","db_duration_s":0.014324,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2197gitlab # [ 248.912173] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.222Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4b8848f102416e6c08bc1518","created_at":"2026-09-14T08:38:22.991Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-2eb938692eb94260","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2b6efc96a3bc0e1dc303104ab2f92f70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.005Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4b8848f102416e6c08bc1518: start","job_status":"start","queue_duration_s":0.216373,"scheduling_latency_s":0.216393}2198gitlab # [ 248.943935] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.254Z","message":"No existing merge request to be cleaned up."}2199gitlab # [ 248.965427] nix-daemon[2785]: accepted connection from pid 3639, user nixbot2200gitlab # [ 248.976074] nix-daemon[2785]: accepted connection from pid 3596, user nixbot2201gitlab # [ 249.009202] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.319Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4b8848f102416e6c08bc1518","created_at":"2026-09-14T08:38:22.991Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-2eb938692eb94260","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2b6efc96a3bc0e1dc303104ab2f92f70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.005Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4b8848f102416e6c08bc1518: done: 0.097118 sec","job_status":"done","queue_duration_s":0.216373,"scheduling_latency_s":0.216393,"redis_calls":12,"redis_duration_s":0.002229,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001403,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.097118,"completed_at":"2026-09-14T08:38:23.319Z","load_balancing_strategy":"primary","db_duration_s":0.002566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2202gitlab # [ 249.031624] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.320Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"74d180f0c001ffd89c31dfe6","created_at":"2026-09-14T08:38:22.991Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-2eb938692eb94260","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2b6efc96a3bc0e1dc303104ab2f92f70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.005Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-74d180f0c001ffd89c31dfe6: start","job_status":"start","queue_duration_s":0.314654,"scheduling_latency_s":0.314671}2203gitlab # [ 249.032525] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.328Z","message":"No existing merge request to be cleaned up."}2204gitlab # [ 249.032999] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.333Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"74d180f0c001ffd89c31dfe6","created_at":"2026-09-14T08:38:22.991Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-2eb938692eb94260","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2b6efc96a3bc0e1dc303104ab2f92f70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.005Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-74d180f0c001ffd89c31dfe6: done: 0.012644 sec","job_status":"done","queue_duration_s":0.314654,"scheduling_latency_s":0.314671,"redis_calls":10,"redis_duration_s":0.0013080000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000816,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012644,"completed_at":"2026-09-14T08:38:23.333Z","load_balancing_strategy":"primary","db_duration_s":0.001321,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2205gitlab # [ 249.081807] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.334Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8b1ee38c1f537f15b7e4f159","created_at":"2026-09-14T08:38:22.991Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-2eb938692eb94260","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2b6efc96a3bc0e1dc303104ab2f92f70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.005Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8b1ee38c1f537f15b7e4f159: start","job_status":"start","queue_duration_s":0.328109,"scheduling_latency_s":0.328122}2206gitlab # [ 249.082638] gitaly[911]: time="2026-09-14T08:38:23.358Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:53.357" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:23.358" grpc.time_ms=0.571 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207gitlab # [ 249.084153] gitaly[911]: time="2026-09-14T08:38:23.394Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:33.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:23.388" grpc.time_ms=5.928 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2208gitlab # [ 249.124693] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1162209gitlab # [ 249.125332] nixbot[2628]: {"ts": "2026-09-14T08:38:23.427Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea \"HTTP/1.1 201 Created\""}2210gitlab # [ 249.133986] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.444Z","message":"No existing merge request to be cleaned up."}2211gitlab # [ 249.147883] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.457Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8b1ee38c1f537f15b7e4f159","created_at":"2026-09-14T08:38:22.991Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-2eb938692eb94260","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2b6efc96a3bc0e1dc303104ab2f92f70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.005Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8b1ee38c1f537f15b7e4f159: done: 0.123309 sec","job_status":"done","queue_duration_s":0.328109,"scheduling_latency_s":0.328122,"redis_calls":10,"redis_duration_s":0.002024,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.101,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.101,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.123309,"completed_at":"2026-09-14T08:38:23.457Z","load_balancing_strategy":"primary","db_duration_s":0.200652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2212gitlab # [ 249.168810] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.459Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"689ae28a08aa06fde2cdb577","created_at":"2026-09-14T08:38:22.991Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-2eb938692eb94260","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2b6efc96a3bc0e1dc303104ab2f92f70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.005Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-689ae28a08aa06fde2cdb577: start","job_status":"start","queue_duration_s":0.453744,"scheduling_latency_s":0.453774}2213gitlab # [ 249.169538] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.468Z","message":"No existing merge request to be cleaned up."}2214gitlab # [ 249.170047] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.473Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"689ae28a08aa06fde2cdb577","created_at":"2026-09-14T08:38:22.991Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-2eb938692eb94260","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2b6efc96a3bc0e1dc303104ab2f92f70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.005Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-689ae28a08aa06fde2cdb577: done: 0.013777 sec","job_status":"done","queue_duration_s":0.453744,"scheduling_latency_s":0.453774,"redis_calls":10,"redis_duration_s":0.001856,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001183,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013777,"completed_at":"2026-09-14T08:38:23.473Z","load_balancing_strategy":"primary","db_duration_s":0.001908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2215gitlab # [ 249.210073] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8ee4428a8484b2e904610a3a","created_at":"2026-09-14T08:38:22.962Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aae60b9c174a64d24d087804824b3236","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.061Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8ee4428a8484b2e904610a3a: start","job_status":"start","queue_duration_s":0.412966,"scheduling_latency_s":0.412978}2216gitlab # [ 249.211074] gitaly[911]: time="2026-09-14T08:38:23.459Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GE53VGEKK5NZSJFP9GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:53.457" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:23.458" grpc.time_ms=0.601 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2217gitlab # [ 249.213753] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8ee4428a8484b2e904610a3a","created_at":"2026-09-14T08:38:22.962Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aae60b9c174a64d24d087804824b3236","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.061Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8ee4428a8484b2e904610a3a: done: 0.018241 sec","job_status":"done","queue_duration_s":0.412966,"scheduling_latency_s":0.412978,"redis_calls":11,"redis_duration_s":0.0022500000000000003,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000662,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000821,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000518781,"exclusive_lock_hold_duration_s":0.002167315,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.018241,"completed_at":"2026-09-14T08:38:23.492Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2218gitlab # [ 249.264217] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"4c21826311765b43d1bc5e09","created_at":"2026-09-14T08:38:23.075Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"634d7c08348bb67fd0ba4dda93aa0f08","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.080Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-4c21826311765b43d1bc5e09: start","job_status":"start","queue_duration_s":0.413109,"scheduling_latency_s":0.413175}2219gitlab # [ 249.266191] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"4c21826311765b43d1bc5e09","created_at":"2026-09-14T08:38:23.075Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"634d7c08348bb67fd0ba4dda93aa0f08","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.080Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-4c21826311765b43d1bc5e09: done: 0.018436 sec","job_status":"done","queue_duration_s":0.413109,"scheduling_latency_s":0.413175,"redis_calls":9,"redis_duration_s":0.001918,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018436,"completed_at":"2026-09-14T08:38:23.511Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2220gitlab # [ 249.319298] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.513Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"74c9356368b07fea24d92466","created_at":"2026-09-14T08:38:23.085Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd89148fb7d64f17429dce0dbc960620","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.088Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-74c9356368b07fea24d92466: start","job_status":"start","queue_duration_s":0.42485,"scheduling_latency_s":0.424864}2221gitlab # [ 249.319966] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.520Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2222gitlab # [ 249.321646] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.526Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"74c9356368b07fea24d92466","created_at":"2026-09-14T08:38:23.085Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd89148fb7d64f17429dce0dbc960620","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.088Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-74c9356368b07fea24d92466: done: 0.0129 sec","job_status":"done","queue_duration_s":0.42485,"scheduling_latency_s":0.424864,"redis_calls":9,"redis_duration_s":0.001949,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000429,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000394,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0129,"completed_at":"2026-09-14T08:38:23.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000452,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2223gitlab # [ 249.392626] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2236c3f6258dd30640f8e0d1","created_at":"2026-09-14T08:38:23.090Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9a9cf5e0ce96b38c5f944de7e979c46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.093Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2236c3f6258dd30640f8e0d1: start","job_status":"start","queue_duration_s":0.434088,"scheduling_latency_s":0.434102}2224gitlab # [ 249.393471] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2236c3f6258dd30640f8e0d1","created_at":"2026-09-14T08:38:23.090Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9a9cf5e0ce96b38c5f944de7e979c46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.093Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2236c3f6258dd30640f8e0d1: done: 0.144809 sec","job_status":"done","queue_duration_s":0.434088,"scheduling_latency_s":0.434102,"redis_calls":13,"redis_duration_s":0.003013,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001269,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000833,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0003872,"exclusive_lock_hold_duration_s":0.128505438,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.144809,"completed_at":"2026-09-14T08:38:23.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2225gitlab # [ 249.444542] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6ab70ebd5f96ef38ca9b194e","created_at":"2026-09-14T08:38:23.095Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56eceb98d10857d38bea54249704877f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.097Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6ab70ebd5f96ef38ca9b194e: start","job_status":"start","queue_duration_s":0.575009,"scheduling_latency_s":0.575023}2226gitlab # [ 249.445495] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.680Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2227gitlab # [ 249.446031] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6ab70ebd5f96ef38ca9b194e","created_at":"2026-09-14T08:38:23.095Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56eceb98d10857d38bea54249704877f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.097Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6ab70ebd5f96ef38ca9b194e: done: 0.01125 sec","job_status":"done","queue_duration_s":0.575009,"scheduling_latency_s":0.575023,"redis_calls":9,"redis_duration_s":0.001066,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01125,"completed_at":"2026-09-14T08:38:23.684Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2228gitlab # [ 249.488165] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"43d258f0f79015c2ab0bc67d","created_at":"2026-09-14T08:38:23.100Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20113a278774d2f881d402b4936a5474","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.103Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-43d258f0f79015c2ab0bc67d: start","job_status":"start","queue_duration_s":0.581975,"scheduling_latency_s":0.581988}2229gitlab # [ 249.489309] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.702Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"43d258f0f79015c2ab0bc67d","created_at":"2026-09-14T08:38:23.100Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20113a278774d2f881d402b4936a5474","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.103Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-43d258f0f79015c2ab0bc67d: done: 0.017111 sec","job_status":"done","queue_duration_s":0.581975,"scheduling_latency_s":0.581988,"redis_calls":11,"redis_duration_s":0.001392,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000281879,"exclusive_lock_hold_duration_s":0.004969626,"duration_s":0.017111,"completed_at":"2026-09-14T08:38:23.702Z","load_balancing_strategy":"primary","db_duration_s":0.003423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab # [ 249.533497] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.703Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"884c89a11cf07282904c7612","created_at":"2026-09-14T08:38:23.116Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5eea2183a13909c1e3f16362b4824381","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.119Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-884c89a11cf07282904c7612: start","job_status":"start","queue_duration_s":0.583543,"scheduling_latency_s":0.583555}2231gitlab # [ 249.534652] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.723Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"884c89a11cf07282904c7612","created_at":"2026-09-14T08:38:23.116Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5eea2183a13909c1e3f16362b4824381","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.119Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-884c89a11cf07282904c7612: done: 0.019793 sec","job_status":"done","queue_duration_s":0.583543,"scheduling_latency_s":0.583555,"redis_calls":12,"redis_duration_s":0.002639,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000401,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005409906,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.019793,"completed_at":"2026-09-14T08:38:23.723Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002689,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2232gitlab # [ 249.600096] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.724Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"efe26ba6e72493a33b404e61","created_at":"2026-09-14T08:38:23.124Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eae5276768c5594d06a348cc4744aab8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.136Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-efe26ba6e72493a33b404e61: start","job_status":"start","queue_duration_s":0.587976,"scheduling_latency_s":0.587989}2233gitlab # [ 249.601215] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"efe26ba6e72493a33b404e61","created_at":"2026-09-14T08:38:23.124Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eae5276768c5594d06a348cc4744aab8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.136Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-efe26ba6e72493a33b404e61: done: 0.012109 sec","job_status":"done","queue_duration_s":0.587976,"scheduling_latency_s":0.587989,"redis_calls":9,"redis_duration_s":0.001869,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00037,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012109,"completed_at":"2026-09-14T08:38:23.736Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 249.650457] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3231b4a3d17550cbef18ad59","created_at":"2026-09-14T08:38:23.138Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4faf2b831ecda708ff355b25525b1d3e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.144Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3231b4a3d17550cbef18ad59: start","job_status":"start","queue_duration_s":0.59268,"scheduling_latency_s":0.592693}2235gitlab # [ 249.659668] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.969Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3231b4a3d17550cbef18ad59","created_at":"2026-09-14T08:38:23.138Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4faf2b831ecda708ff355b25525b1d3e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.144Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3231b4a3d17550cbef18ad59: done: 0.232423 sec","job_status":"done","queue_duration_s":0.59268,"scheduling_latency_s":0.592693,"redis_calls":564,"redis_duration_s":0.076069,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.074649,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.181554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.232423,"completed_at":"2026-09-14T08:38:23.969Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000429,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2236gitlab # [ 249.709387] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"35f948c8b30cfaee5b7b3aa9","created_at":"2026-09-14T08:38:23.149Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24d2950fb7b027400f7d7a5253162a39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.156Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-35f948c8b30cfaee5b7b3aa9: start","job_status":"start","queue_duration_s":0.814866,"scheduling_latency_s":0.814886}2237gitlab # [ 249.710447] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.979Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2238gitlab # [ 249.711147] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"35f948c8b30cfaee5b7b3aa9","created_at":"2026-09-14T08:38:23.149Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24d2950fb7b027400f7d7a5253162a39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.156Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-35f948c8b30cfaee5b7b3aa9: done: 0.013144 sec","job_status":"done","queue_duration_s":0.814866,"scheduling_latency_s":0.814886,"redis_calls":9,"redis_duration_s":0.0017850000000000001,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000393,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000374,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013144,"completed_at":"2026-09-14T08:38:23.984Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2239gitlab # [ 249.754366] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.985Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f04bcb8d5124ac1c7c95f63c","created_at":"2026-09-14T08:38:23.161Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccb093938c07f8e2d3b1e08eeabc7b14","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.169Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f04bcb8d5124ac1c7c95f63c: start","job_status":"start","queue_duration_s":0.815307,"scheduling_latency_s":0.81532}2240gitlab # [ 249.755349] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.997Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f04bcb8d5124ac1c7c95f63c","created_at":"2026-09-14T08:38:23.161Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccb093938c07f8e2d3b1e08eeabc7b14","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.169Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f04bcb8d5124ac1c7c95f63c: done: 0.012091 sec","job_status":"done","queue_duration_s":0.815307,"scheduling_latency_s":0.81532,"redis_calls":11,"redis_duration_s":0.00233,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.000399,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012091,"completed_at":"2026-09-14T08:38:23.997Z","load_balancing_strategy":"primary","db_duration_s":0.000444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2241gitlab # [ 249.795762] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:23.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"60b7f5b58e20901171692ae7","created_at":"2026-09-14T08:38:23.181Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e06c031fc8abfa34cbf51f71c511ba6f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.191Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-60b7f5b58e20901171692ae7: start","job_status":"start","queue_duration_s":0.806428,"scheduling_latency_s":0.806441}2242gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses2243gitlab # [ 249.839996] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"60b7f5b58e20901171692ae7","created_at":"2026-09-14T08:38:23.181Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e06c031fc8abfa34cbf51f71c511ba6f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.191Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-60b7f5b58e20901171692ae7: done: 0.034006 sec","job_status":"done","queue_duration_s":0.806428,"scheduling_latency_s":0.806441,"redis_calls":13,"redis_duration_s":0.0033,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000869,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000432178,"exclusive_lock_hold_duration_s":0.018920841,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.034006,"completed_at":"2026-09-14T08:38:24.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2244gitlab # [ 249.842171] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d9d17f3c236734818ce0d497","created_at":"2026-09-14T08:38:23.197Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"269302dee30a280526c1cc61697d4f13","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T08:38:23.202Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d9d17f3c236734818ce0d497: start","job_status":"start","queue_duration_s":0.830551,"scheduling_latency_s":0.830565}2245gitlab # [ 249.885897] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.041Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2246gitlab # [ 249.886680] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d9d17f3c236734818ce0d497","created_at":"2026-09-14T08:38:23.197Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"269302dee30a280526c1cc61697d4f13","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T08:38:23.202Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d9d17f3c236734818ce0d497: done: 0.012065 sec","job_status":"done","queue_duration_s":0.830551,"scheduling_latency_s":0.830565,"redis_calls":9,"redis_duration_s":0.001856,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000463,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012065,"completed_at":"2026-09-14T08:38:24.045Z","load_balancing_strategy":"primary","db_duration_s":0.000472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2247gitlab # [ 249.894357] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.046Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b1a87bb8fda4b4edd2487007","created_at":"2026-09-14T08:38:23.205Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d4f7fa0eb45109002b965a78f869931","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.211Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b1a87bb8fda4b4edd2487007: start","job_status":"start","queue_duration_s":0.8356,"scheduling_latency_s":0.835613}2248gitlab # [ 249.907186] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.063Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b1a87bb8fda4b4edd2487007","created_at":"2026-09-14T08:38:23.205Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d4f7fa0eb45109002b965a78f869931","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.211Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b1a87bb8fda4b4edd2487007: done: 0.016624 sec","job_status":"done","queue_duration_s":0.8356,"scheduling_latency_s":0.835613,"redis_calls":9,"redis_duration_s":0.001966,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000407,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016624,"completed_at":"2026-09-14T08:38:24.063Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2249gitlab # [ 249.947828] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"311d2056be12f9a6bbef45cb","created_at":"2026-09-14T08:38:23.212Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4293d644034e213b806d4e6860d74cdd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.217Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-311d2056be12f9a6bbef45cb: start","job_status":"start","queue_duration_s":0.847201,"scheduling_latency_s":0.847214}2250gitlab # [ 249.957185] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.071Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2251gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses, in 0.14 seconds)2252gitlab # [ 249.959928] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.076Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"311d2056be12f9a6bbef45cb","created_at":"2026-09-14T08:38:23.212Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4293d644034e213b806d4e6860d74cdd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.217Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-311d2056be12f9a6bbef45cb: done: 0.011738 sec","job_status":"done","queue_duration_s":0.847201,"scheduling_latency_s":0.847214,"redis_calls":9,"redis_duration_s":0.0017859999999999998,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000398,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000371,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011738,"completed_at":"2026-09-14T08:38:24.076Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000401,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2253gitlab # [ 250.017447] gitaly[911]: time="2026-09-14T08:38:24.241Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2GE53VGEKK5NZSJFP9GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:34.198" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:24.229" grpc.time_ms=11.472 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2254gitlab # [ 250.018560] gitaly[911]: time="2026-09-14T08:38:24.282Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:24.281" grpc.time_ms=0.352 pid=911 span.kind=server system=grpc2255gitlab # [ 250.019681] nixbot[2628]: {"ts": "2026-09-14T08:38:24.287Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea \"HTTP/1.1 201 Created\""}2256gitlab # [ 250.022432] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"659e20bed798a87c44c6818d","created_at":"2026-09-14T08:38:23.218Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.228Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-659e20bed798a87c44c6818d: start","job_status":"start","queue_duration_s":0.848858,"scheduling_latency_s":0.848872}2257gitlab # [ 250.073024] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"659e20bed798a87c44c6818d","created_at":"2026-09-14T08:38:23.218Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.228Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-659e20bed798a87c44c6818d: done: 0.067733 sec","job_status":"done","queue_duration_s":0.848858,"scheduling_latency_s":0.848872,"redis_calls":70,"redis_duration_s":0.014546,"redis_read_bytes":118,"redis_write_bytes":42530,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002082,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000744,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.011159,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000561,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067733,"completed_at":"2026-09-14T08:38:24.144Z","load_balancing_strategy":"primary","db_duration_s":0.001794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2258gitlab # [ 250.074417] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 8552259gitlab # [ 250.075979] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 822260gitlab # [ 250.078926] gitaly[911]: time="2026-09-14T08:38:24.312Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2H7PY2JT4Y7AY0GPR6HP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:54.211" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:24.311" grpc.time_ms=0.436 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab # [ 250.125415] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.146Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"5d1a35835b4c5f07bf08bdc8","created_at":"2026-09-14T08:38:23.232Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a80c9018c0b2d450917f8c9d23142ca","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.236Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-5d1a35835b4c5f07bf08bdc8: start","job_status":"start","queue_duration_s":0.910304,"scheduling_latency_s":0.910322}2262gitlab # [ 250.125962] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"5d1a35835b4c5f07bf08bdc8","created_at":"2026-09-14T08:38:23.232Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-1ed8a67015bc422f","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a80c9018c0b2d450917f8c9d23142ca","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.236Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-5d1a35835b4c5f07bf08bdc8: done: 0.018455 sec","job_status":"done","queue_duration_s":0.910304,"scheduling_latency_s":0.910322,"redis_calls":11,"redis_duration_s":0.002505,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00037435,"exclusive_lock_hold_duration_s":0.003870324,"duration_s":0.018455,"completed_at":"2026-09-14T08:38:24.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002792,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2263gitlab # [ 250.167378] nixbot[2628]: {"ts": "2026-09-14T08:38:24.399Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea \"HTTP/1.1 201 Created\""}2264gitlab # [ 250.168067] gitaly[911]: time="2026-09-14T08:38:24.346Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2H9E10F0T6WQTJEYX07S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:54.345" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:24.346" grpc.time_ms=0.419 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2265gitlab # [ 250.168684] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 962266gitlab # [ 250.169178] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.166Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4915008d8ec8dc51511bdf4f","created_at":"2026-09-14T08:38:23.415Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-08267b0c2b1d49ee","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.417Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4915008d8ec8dc51511bdf4f: start","job_status":"start","queue_duration_s":0.748238,"scheduling_latency_s":0.748251}2267gitlab # [ 250.171454] gitaly[911]: time="2026-09-14T08:38:24.371Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2H9E10F0T6WQTJEYX07S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T08:38:34.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:24.364" grpc.time_ms=6.512 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2268gitlab # [ 250.231574] gitaly[911]: time="2026-09-14T08:38:24.541Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:24.541" grpc.time_ms=0.729 pid=911 span.kind=server system=grpc2269gitlab # [ 250.258127] gitaly[911]: time="2026-09-14T08:38:24.568Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:24.568" grpc.time_ms=0.35 pid=911 span.kind=server system=grpc2270gitlab # [ 250.269622] gitaly[911]: time="2026-09-14T08:38:24.580Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:54.228" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:24.229" operations="[repack_refs]" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2271gitlab # [ 250.276309] gitaly[911]: time="2026-09-14T08:38:24.586Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF diskcache=625204b6-d376-4cfd-8b1e-4cbb9931f7c4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:54.228" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:24.229" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2272gitlab # [ 250.276926] gitaly[911]: time="2026-09-14T08:38:24.587Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=71 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=823296 command.minflt=7099 command.oublock=0 command.real_time_ms=349 command.spawn_token_fork_ms=0 command.system_time_ms=52 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:54.228" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:24.229" grpc.time_ms=357.869 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 250.301691] gitaly[911]: time="2026-09-14T08:38:24.612Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:54.228" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:24.229" pid=911 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-14 08:37:20.003020335 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2274gitlab # [ 250.313159] gitaly[911]: time="2026-09-14T08:38:24.622Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2HJ90NK0QHC18AB89J3B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:24.616" grpc.time_ms=6.574 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2275gitlab # [ 250.313947] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 372276gitlab # [ 250.317340] gitaly[911]: time="2026-09-14T08:38:24.627Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:54.228" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:24.229" pid=911 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2277gitlab # [ 250.318025] gitaly[911]: time="2026-09-14T08:38:24.628Z" level=info msg="optimized repository" clean_stale_data_time=15.318148ms clean_work_trees_time="74.031µs" commit_graph_time="3.631µs" correlation_id=01M2FH2GADJ7999Z571WMJNCMF gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.632µs" pid=911 prune_time="3.632µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.749µs" storage_name=default system=housekeeping total_time=15.505043ms2278gitlab # [ 250.318616] gitaly[911]: time="2026-09-14T08:38:24.628Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:54.228" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:24.229" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2279gitlab # [ 250.332221] gitaly[911]: time="2026-09-14T08:38:24.642Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T08:38:54.641" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:24.642" grpc.time_ms=0.62 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2280gitlab # [ 250.350042] gitaly[911]: time="2026-09-14T08:38:24.660Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:54.659" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:24.659" grpc.time_ms=0.403 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2281gitlab # [ 250.355560] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.665Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"52152a035eedc2b3268344df","created_at":"2026-09-14T08:38:24.664Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"4915008d8ec8dc51511bdf4f","job_size_bytes":3,"pid":2503,"job_status":"deduplicated","message":"PipelineProcessWorker JID-52152a035eedc2b3268344df: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2282gitlab # [ 250.356441] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.666Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4915008d8ec8dc51511bdf4f","created_at":"2026-09-14T08:38:23.415Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-08267b0c2b1d49ee","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.417Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2503,"job_status":"rescheduled","message":"PipelineProcessWorker JID-4915008d8ec8dc51511bdf4f: rescheduled"}2283gitlab # [ 250.361723] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.670Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4915008d8ec8dc51511bdf4f","created_at":"2026-09-14T08:38:23.415Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-08267b0c2b1d49ee","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:23.417Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4915008d8ec8dc51511bdf4f: done: 0.504619 sec","job_status":"done","queue_duration_s":0.748238,"scheduling_latency_s":0.748251,"gitaly_calls":3,"gitaly_duration_s":0.364213,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011386,"redis_read_bytes":248,"redis_write_bytes":21783,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000912,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001019,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002948,"redis_queues_read_bytes":37,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.00381,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00022,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000319,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001246,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095313,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.479315667,"duration_s":0.504619,"completed_at":"2026-09-14T08:38:24.670Z","load_balancing_strategy":"primary","db_duration_s":0.028379,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2284gitlab # [ 250.408034] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0d546c2c469ca6f1c4292dc","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0d546c2c469ca6f1c4292dc: start","job_status":"start","queue_duration_s":0.534142,"scheduling_latency_s":0.534156}2285gitlab # [ 250.419654] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0d546c2c469ca6f1c4292dc","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0d546c2c469ca6f1c4292dc: done: 0.014223 sec","job_status":"done","queue_duration_s":0.534142,"scheduling_latency_s":0.534156,"redis_calls":15,"redis_duration_s":0.001764,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014223,"completed_at":"2026-09-14T08:38:24.686Z","load_balancing_strategy":"primary","db_duration_s":0.000273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 250.460242] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7487e51061f1f04ead717476","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7487e51061f1f04ead717476: start","job_status":"start","queue_duration_s":0.549187,"scheduling_latency_s":0.5492}2287gitlab # [ 250.505362] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7487e51061f1f04ead717476","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7487e51061f1f04ead717476: done: 0.008885 sec","job_status":"done","queue_duration_s":0.549187,"scheduling_latency_s":0.5492,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008885,"completed_at":"2026-09-14T08:38:24.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 250.506493] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff18a2b932e7cc109b860702","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff18a2b932e7cc109b860702: start","job_status":"start","queue_duration_s":0.558842,"scheduling_latency_s":0.558855}2289gitlab # [ 250.513277] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff18a2b932e7cc109b860702","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff18a2b932e7cc109b860702: done: 0.008528 sec","job_status":"done","queue_duration_s":0.558842,"scheduling_latency_s":0.558855,"redis_calls":13,"redis_duration_s":0.001417,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008528,"completed_at":"2026-09-14T08:38:24.705Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2290gitlab # [ 250.566976] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2308abc58eb47c9c038a56ba","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2308abc58eb47c9c038a56ba: start","job_status":"start","queue_duration_s":0.568162,"scheduling_latency_s":0.568174}2291gitlab # [ 250.567613] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2308abc58eb47c9c038a56ba","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2308abc58eb47c9c038a56ba: done: 0.008596 sec","job_status":"done","queue_duration_s":0.568162,"scheduling_latency_s":0.568174,"redis_calls":13,"redis_duration_s":0.001596,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008596,"completed_at":"2026-09-14T08:38:24.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 250.607549] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5401dccbbbc11d0eece3dfe3","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5401dccbbbc11d0eece3dfe3: start","job_status":"start","queue_duration_s":0.577563,"scheduling_latency_s":0.577575}2293gitlab # [ 250.608420] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5401dccbbbc11d0eece3dfe3","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5401dccbbbc11d0eece3dfe3: done: 0.008649 sec","job_status":"done","queue_duration_s":0.577563,"scheduling_latency_s":0.577575,"redis_calls":13,"redis_duration_s":0.0015110000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008649,"completed_at":"2026-09-14T08:38:24.723Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2294gitlab # [ 250.657221] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34516813a6f2231c95b812ec","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34516813a6f2231c95b812ec: start","job_status":"start","queue_duration_s":0.586998,"scheduling_latency_s":0.58701}2295gitlab # [ 250.657935] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34516813a6f2231c95b812ec","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34516813a6f2231c95b812ec: done: 0.008571 sec","job_status":"done","queue_duration_s":0.586998,"scheduling_latency_s":0.58701,"redis_calls":13,"redis_duration_s":0.0014819999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008571,"completed_at":"2026-09-14T08:38:24.733Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 250.700619] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1079c856f457b4a0d6982e90","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1079c856f457b4a0d6982e90: start","job_status":"start","queue_duration_s":0.596357,"scheduling_latency_s":0.596369}2297gitlab # [ 250.701593] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1079c856f457b4a0d6982e90","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1079c856f457b4a0d6982e90: done: 0.00866 sec","job_status":"done","queue_duration_s":0.596357,"scheduling_latency_s":0.596369,"redis_calls":13,"redis_duration_s":0.0016709999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00866,"completed_at":"2026-09-14T08:38:24.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2298gitlab # [ 250.762698] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8295538b8133c00a59034f7","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8295538b8133c00a59034f7: start","job_status":"start","queue_duration_s":0.605786,"scheduling_latency_s":0.605798}2299gitlab # [ 250.763639] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8295538b8133c00a59034f7","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8295538b8133c00a59034f7: done: 0.008514 sec","job_status":"done","queue_duration_s":0.605786,"scheduling_latency_s":0.605798,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008514,"completed_at":"2026-09-14T08:38:24.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 250.807226] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b288637e7b1fda72abf28cbc","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b288637e7b1fda72abf28cbc: start","job_status":"start","queue_duration_s":0.61557,"scheduling_latency_s":0.615603}2301gitlab # [ 250.807949] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b288637e7b1fda72abf28cbc","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b288637e7b1fda72abf28cbc: done: 0.011936 sec","job_status":"done","queue_duration_s":0.61557,"scheduling_latency_s":0.615603,"redis_calls":13,"redis_duration_s":0.001577,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011936,"completed_at":"2026-09-14T08:38:24.765Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2302gitlab # [ 250.829841] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6e4f61213322ac1ee375d71","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6e4f61213322ac1ee375d71: start","job_status":"start","queue_duration_s":0.628334,"scheduling_latency_s":0.628347}2303gitlab # [ 250.868863] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6e4f61213322ac1ee375d71","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6e4f61213322ac1ee375d71: done: 0.008763 sec","job_status":"done","queue_duration_s":0.628334,"scheduling_latency_s":0.628347,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008763,"completed_at":"2026-09-14T08:38:24.774Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2304gitlab # [ 250.876482] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5e51b0ff483beb091ff986e","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5e51b0ff483beb091ff986e: start","job_status":"start","queue_duration_s":0.637908,"scheduling_latency_s":0.637948}2305gitlab # [ 250.887614] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5e51b0ff483beb091ff986e","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5e51b0ff483beb091ff986e: done: 0.008875 sec","job_status":"done","queue_duration_s":0.637908,"scheduling_latency_s":0.637948,"redis_calls":13,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008875,"completed_at":"2026-09-14T08:38:24.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2306gitlab # [ 250.928032] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4ba734137c9f0195f8bfec0","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4ba734137c9f0195f8bfec0: start","job_status":"start","queue_duration_s":0.647614,"scheduling_latency_s":0.647626}2307gitlab # [ 250.933953] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4ba734137c9f0195f8bfec0","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4ba734137c9f0195f8bfec0: done: 0.008982 sec","job_status":"done","queue_duration_s":0.647614,"scheduling_latency_s":0.647626,"redis_calls":13,"redis_duration_s":0.001633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008982,"completed_at":"2026-09-14T08:38:24.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2308gitlab # [ 250.974748] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c945fc47dba62fc2180b4df1","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c945fc47dba62fc2180b4df1: start","job_status":"start","queue_duration_s":0.657422,"scheduling_latency_s":0.657436}2309gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses2310gitlab # [ 251.017862] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c945fc47dba62fc2180b4df1","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c945fc47dba62fc2180b4df1: done: 0.008741 sec","job_status":"done","queue_duration_s":0.657422,"scheduling_latency_s":0.657436,"redis_calls":13,"redis_duration_s":0.0014420000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008741,"completed_at":"2026-09-14T08:38:24.803Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2311gitlab # [ 251.018489] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"509dfbd9638ed603ce10b2b3","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-509dfbd9638ed603ce10b2b3: start","job_status":"start","queue_duration_s":0.666967,"scheduling_latency_s":0.66698}2312gitlab # [ 251.026092] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"509dfbd9638ed603ce10b2b3","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-509dfbd9638ed603ce10b2b3: done: 0.008713 sec","job_status":"done","queue_duration_s":0.666967,"scheduling_latency_s":0.66698,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008713,"completed_at":"2026-09-14T08:38:24.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2313gitlab # [ 251.088537] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2fd641568c8ffbc84e0ab4b","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2fd641568c8ffbc84e0ab4b: start","job_status":"start","queue_duration_s":0.676466,"scheduling_latency_s":0.676478}2314gitlab # [ 251.089423] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2fd641568c8ffbc84e0ab4b","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2fd641568c8ffbc84e0ab4b: done: 0.011955 sec","job_status":"done","queue_duration_s":0.676466,"scheduling_latency_s":0.676478,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011955,"completed_at":"2026-09-14T08:38:24.826Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 251.133041] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e796f4c53ef393a22447373","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e796f4c53ef393a22447373: start","job_status":"start","queue_duration_s":0.689416,"scheduling_latency_s":0.68943}2316gitlab # [ 251.133902] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e796f4c53ef393a22447373","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e796f4c53ef393a22447373: done: 0.011663 sec","job_status":"done","queue_duration_s":0.689416,"scheduling_latency_s":0.68943,"redis_calls":13,"redis_duration_s":0.001801,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011663,"completed_at":"2026-09-14T08:38:24.838Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2317gitlab # [ 251.173878] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be4c6efef169f99339b31289","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be4c6efef169f99339b31289: start","job_status":"start","queue_duration_s":0.702082,"scheduling_latency_s":0.702101}2318gitlab # [ 251.174071] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be4c6efef169f99339b31289","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be4c6efef169f99339b31289: done: 0.009391 sec","job_status":"done","queue_duration_s":0.702082,"scheduling_latency_s":0.702101,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009391,"completed_at":"2026-09-14T08:38:24.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 251.196773] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"518197b3d5a81844b2028178","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-518197b3d5a81844b2028178: start","job_status":"start","queue_duration_s":0.712245,"scheduling_latency_s":0.712257}2320gitlab # [ 251.243335] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"518197b3d5a81844b2028178","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-518197b3d5a81844b2028178: done: 0.00842 sec","job_status":"done","queue_duration_s":0.712245,"scheduling_latency_s":0.712257,"redis_calls":13,"redis_duration_s":0.001429,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00842,"completed_at":"2026-09-14T08:38:24.858Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 251.244456] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d542ddd6d2bc2c2a3e340b1d","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d542ddd6d2bc2c2a3e340b1d: start","job_status":"start","queue_duration_s":0.721459,"scheduling_latency_s":0.721471}2322gitlab # [ 251.255449] gitaly[911]: time="2026-09-14T08:38:25.544Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:25.543" grpc.time_ms=0.742 pid=911 span.kind=server system=grpc2323gitlab # [ 251.301722] gitaly[911]: time="2026-09-14T08:38:25.563Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:25.562" grpc.time_ms=0.612 pid=911 span.kind=server system=grpc2324gitlab # [ 251.302620] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d542ddd6d2bc2c2a3e340b1d","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d542ddd6d2bc2c2a3e340b1d: done: 0.008556 sec","job_status":"done","queue_duration_s":0.721459,"scheduling_latency_s":0.721471,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008556,"completed_at":"2026-09-14T08:38:24.867Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab # [ 251.340792] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"474ceb469f16a4909eacaacc","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-474ceb469f16a4909eacaacc: start","job_status":"start","queue_duration_s":0.730794,"scheduling_latency_s":0.730807}2326gitlab # [ 251.341670] gitaly[911]: time="2026-09-14T08:38:25.581Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T08:38:25.581" grpc.time_ms=0.247 pid=911 span.kind=server system=grpc2327gitlab # [ 251.342385] gitaly[911]: time="2026-09-14T08:38:25.590Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF diskcache=008ae9c9-d6f2-46b9-834c-621bf754958d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:55.521" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:25.522" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2328gitlab # [ 251.342988] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"474ceb469f16a4909eacaacc","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-474ceb469f16a4909eacaacc: done: 0.008484 sec","job_status":"done","queue_duration_s":0.730794,"scheduling_latency_s":0.730807,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008484,"completed_at":"2026-09-14T08:38:24.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2329gitlab # [ 251.388618] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df20cace209bec84a5311434","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df20cace209bec84a5311434: start","job_status":"start","queue_duration_s":0.740097,"scheduling_latency_s":0.740111}2330gitlab # [ 251.389423] gitaly[911]: time="2026-09-14T08:38:25.590Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=68 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7415 command.oublock=0 command.real_time_ms=61 command.spawn_token_fork_ms=0 command.system_time_ms=41 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T08:38:55.521" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T08:38:25.522" grpc.time_ms=68.268 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2331gitlab # [ 251.392942] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df20cace209bec84a5311434","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df20cace209bec84a5311434: done: 0.008506 sec","job_status":"done","queue_duration_s":0.740097,"scheduling_latency_s":0.740111,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008506,"completed_at":"2026-09-14T08:38:24.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2332gitlab # [ 251.441728] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d92b4e3d1cbc4c4ebbea5500","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d92b4e3d1cbc4c4ebbea5500: start","job_status":"start","queue_duration_s":0.749405,"scheduling_latency_s":0.749417}2333gitlab # [ 251.442546] gitaly[911]: time="2026-09-14T08:38:25.685Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=58 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=58 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T08:38:55.626" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:25.626" grpc.time_ms=59.403 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2334gitlab # [ 251.483557] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d92b4e3d1cbc4c4ebbea5500","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d92b4e3d1cbc4c4ebbea5500: done: 0.008798 sec","job_status":"done","queue_duration_s":0.749405,"scheduling_latency_s":0.749417,"redis_calls":13,"redis_duration_s":0.0017159999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008798,"completed_at":"2026-09-14T08:38:24.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2335gitlab # [ 251.523720] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ed1ee39f7d11a8c64491777","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ed1ee39f7d11a8c64491777: start","job_status":"start","queue_duration_s":0.759005,"scheduling_latency_s":0.759025}2336gitlab # [ 251.524556] gitaly[911]: time="2026-09-14T08:38:25.706Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2GADJ7999Z571WMJNCMF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:55.705" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:25.706" grpc.time_ms=0.526 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2337gitlab # [ 251.525401] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ed1ee39f7d11a8c64491777","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ed1ee39f7d11a8c64491777: done: 0.008447 sec","job_status":"done","queue_duration_s":0.759005,"scheduling_latency_s":0.759025,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008447,"completed_at":"2026-09-14T08:38:24.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2338gitlab # [ 251.572899] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5358998159506e0d249f09aa","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5358998159506e0d249f09aa: start","job_status":"start","queue_duration_s":0.768249,"scheduling_latency_s":0.768262}2339gitlab # [ 251.573735] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5358998159506e0d249f09aa","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5358998159506e0d249f09aa: done: 0.008439 sec","job_status":"done","queue_duration_s":0.768249,"scheduling_latency_s":0.768262,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008439,"completed_at":"2026-09-14T08:38:24.914Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2340gitlab # [ 251.611997] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52ba172459ea32e00d01a231","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52ba172459ea32e00d01a231: start","job_status":"start","queue_duration_s":0.777466,"scheduling_latency_s":0.777478}2341gitlab # [ 251.612624] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52ba172459ea32e00d01a231","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52ba172459ea32e00d01a231: done: 0.011165 sec","job_status":"done","queue_duration_s":0.777466,"scheduling_latency_s":0.777478,"redis_calls":13,"redis_duration_s":0.001845,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011165,"completed_at":"2026-09-14T08:38:24.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2342gitlab # [ 251.656566] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f43d3979e65a85837f65c20c","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f43d3979e65a85837f65c20c: start","job_status":"start","queue_duration_s":0.789696,"scheduling_latency_s":0.789717}2343gitlab # [ 251.657448] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f43d3979e65a85837f65c20c","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f43d3979e65a85837f65c20c: done: 0.009626 sec","job_status":"done","queue_duration_s":0.789696,"scheduling_latency_s":0.789717,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009626,"completed_at":"2026-09-14T08:38:24.936Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2344gitlab # [ 251.702503] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"809addc9c95f834603950d89","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-809addc9c95f834603950d89: start","job_status":"start","queue_duration_s":0.800115,"scheduling_latency_s":0.800129}2345gitlab # [ 251.703155] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"809addc9c95f834603950d89","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-809addc9c95f834603950d89: done: 0.008934 sec","job_status":"done","queue_duration_s":0.800115,"scheduling_latency_s":0.800129,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008934,"completed_at":"2026-09-14T08:38:24.946Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2346gitlab # [ 251.745923] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0965eb02c35cf9c83a2e2a42","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0965eb02c35cf9c83a2e2a42: start","job_status":"start","queue_duration_s":0.809815,"scheduling_latency_s":0.809829}2347gitlab # [ 251.746702] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0965eb02c35cf9c83a2e2a42","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0965eb02c35cf9c83a2e2a42: done: 0.008713 sec","job_status":"done","queue_duration_s":0.809815,"scheduling_latency_s":0.809829,"redis_calls":13,"redis_duration_s":0.001387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000452,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008713,"completed_at":"2026-09-14T08:38:24.956Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2348gitlab # [ 251.784913] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f416818a9ea7e9461ba66106","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f416818a9ea7e9461ba66106: start","job_status":"start","queue_duration_s":0.81934,"scheduling_latency_s":0.819353}2349gitlab # [ 251.785562] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f416818a9ea7e9461ba66106","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f416818a9ea7e9461ba66106: done: 0.008732 sec","job_status":"done","queue_duration_s":0.81934,"scheduling_latency_s":0.819353,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008732,"completed_at":"2026-09-14T08:38:24.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2350gitlab # [ 251.815488] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eedb2911cee3d144d6d9c37","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eedb2911cee3d144d6d9c37: start","job_status":"start","queue_duration_s":0.828867,"scheduling_latency_s":0.828879}2351gitlab # [ 251.826520] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eedb2911cee3d144d6d9c37","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eedb2911cee3d144d6d9c37: done: 0.008745 sec","job_status":"done","queue_duration_s":0.828867,"scheduling_latency_s":0.828879,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008745,"completed_at":"2026-09-14T08:38:24.975Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2352gitlab # [ 251.865635] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"200ec04e58eb7017c028b88a","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-200ec04e58eb7017c028b88a: start","job_status":"start","queue_duration_s":0.83843,"scheduling_latency_s":0.838444}2353gitlab # [ 251.871092] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"200ec04e58eb7017c028b88a","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-200ec04e58eb7017c028b88a: done: 0.008627 sec","job_status":"done","queue_duration_s":0.83843,"scheduling_latency_s":0.838444,"redis_calls":13,"redis_duration_s":0.001396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008627,"completed_at":"2026-09-14T08:38:24.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2354gitlab # [ 251.915249] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08e70f32be527b4694e08a59","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08e70f32be527b4694e08a59: start","job_status":"start","queue_duration_s":0.847827,"scheduling_latency_s":0.847839}2355gitlab # [ 251.916425] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08e70f32be527b4694e08a59","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08e70f32be527b4694e08a59: done: 0.008598 sec","job_status":"done","queue_duration_s":0.847827,"scheduling_latency_s":0.847839,"redis_calls":13,"redis_duration_s":0.001385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000449,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008598,"completed_at":"2026-09-14T08:38:24.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2356gitlab # [ 251.974680] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:24.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ff2da6debe55bdc0a27da98","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ff2da6debe55bdc0a27da98: start","job_status":"start","queue_duration_s":0.857218,"scheduling_latency_s":0.857231}2357gitlab # [ 251.975490] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ff2da6debe55bdc0a27da98","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ff2da6debe55bdc0a27da98: done: 0.008861 sec","job_status":"done","queue_duration_s":0.857218,"scheduling_latency_s":0.857231,"redis_calls":13,"redis_duration_s":0.0014039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008861,"completed_at":"2026-09-14T08:38:25.003Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2358gitlab # [ 251.996537] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"588988adaab33823c067e201","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-588988adaab33823c067e201: start","job_status":"start","queue_duration_s":0.866945,"scheduling_latency_s":0.866959}2359gitlab # [ 252.007622] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"588988adaab33823c067e201","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-588988adaab33823c067e201: done: 0.009077 sec","job_status":"done","queue_duration_s":0.866945,"scheduling_latency_s":0.866959,"redis_calls":13,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009077,"completed_at":"2026-09-14T08:38:25.013Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 252.046683] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09b50da361c8b36230ae8b78","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09b50da361c8b36230ae8b78: start","job_status":"start","queue_duration_s":0.87682,"scheduling_latency_s":0.876832}2361gitlab # [ 252.085382] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09b50da361c8b36230ae8b78","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09b50da361c8b36230ae8b78: done: 0.008772 sec","job_status":"done","queue_duration_s":0.87682,"scheduling_latency_s":0.876832,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008772,"completed_at":"2026-09-14T08:38:25.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2362gitlab # [ 252.086462] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e18185278915d438743b1ca3","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e18185278915d438743b1ca3: start","job_status":"start","queue_duration_s":0.886436,"scheduling_latency_s":0.886449}2363gitlab # [ 252.097240] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e18185278915d438743b1ca3","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e18185278915d438743b1ca3: done: 0.008885 sec","job_status":"done","queue_duration_s":0.886436,"scheduling_latency_s":0.886449,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008885,"completed_at":"2026-09-14T08:38:25.032Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2364gitlab # [ 252.144954] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81c980c8c1fc6a5c6b66a016","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81c980c8c1fc6a5c6b66a016: start","job_status":"start","queue_duration_s":0.896197,"scheduling_latency_s":0.89621}2365gitlab # [ 252.145598] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81c980c8c1fc6a5c6b66a016","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81c980c8c1fc6a5c6b66a016: done: 0.009013 sec","job_status":"done","queue_duration_s":0.896197,"scheduling_latency_s":0.89621,"redis_calls":13,"redis_duration_s":0.00159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009013,"completed_at":"2026-09-14T08:38:25.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2366gitlab # [ 252.203693] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31242d7062455a7a7d8d970f","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31242d7062455a7a7d8d970f: start","job_status":"start","queue_duration_s":0.906207,"scheduling_latency_s":0.906222}2367gitlab # [ 252.204527] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31242d7062455a7a7d8d970f","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31242d7062455a7a7d8d970f: done: 0.008984 sec","job_status":"done","queue_duration_s":0.906207,"scheduling_latency_s":0.906222,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008984,"completed_at":"2026-09-14T08:38:25.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2368gitlab # [ 252.246942] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"742097f8fca67aa226a92e48","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-742097f8fca67aa226a92e48: start","job_status":"start","queue_duration_s":0.915997,"scheduling_latency_s":0.91601}2369gitlab # [ 252.247639] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"742097f8fca67aa226a92e48","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-742097f8fca67aa226a92e48: done: 0.008938 sec","job_status":"done","queue_duration_s":0.915997,"scheduling_latency_s":0.91601,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008938,"completed_at":"2026-09-14T08:38:25.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2370gitlab # [ 252.287533] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1a09d3dec00e36a2a9a66fd","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1a09d3dec00e36a2a9a66fd: start","job_status":"start","queue_duration_s":0.925745,"scheduling_latency_s":0.925758}2371gitlab # [ 252.288409] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1a09d3dec00e36a2a9a66fd","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1a09d3dec00e36a2a9a66fd: done: 0.008878 sec","job_status":"done","queue_duration_s":0.925745,"scheduling_latency_s":0.925758,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008878,"completed_at":"2026-09-14T08:38:25.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2372gitlab # [ 252.331915] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb4d0628ffacd5ceb0e04b0a","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb4d0628ffacd5ceb0e04b0a: start","job_status":"start","queue_duration_s":0.935435,"scheduling_latency_s":0.935449}2373gitlab # [ 252.332645] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb4d0628ffacd5ceb0e04b0a","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb4d0628ffacd5ceb0e04b0a: done: 0.008841 sec","job_status":"done","queue_duration_s":0.935435,"scheduling_latency_s":0.935449,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008841,"completed_at":"2026-09-14T08:38:25.081Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2374gitlab # [ 252.370936] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0003b8451e684cd04d9f820","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0003b8451e684cd04d9f820: start","job_status":"start","queue_duration_s":0.945083,"scheduling_latency_s":0.945096}2375gitlab # [ 252.371620] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0003b8451e684cd04d9f820","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0003b8451e684cd04d9f820: done: 0.008885 sec","job_status":"done","queue_duration_s":0.945083,"scheduling_latency_s":0.945096,"redis_calls":13,"redis_duration_s":0.001379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008885,"completed_at":"2026-09-14T08:38:25.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2376gitlab # [ 252.420280] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"737f5f1028f993367a149bd9","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-737f5f1028f993367a149bd9: start","job_status":"start","queue_duration_s":0.954749,"scheduling_latency_s":0.954761}2377gitlab # [ 252.420926] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"737f5f1028f993367a149bd9","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-737f5f1028f993367a149bd9: done: 0.00879 sec","job_status":"done","queue_duration_s":0.954749,"scheduling_latency_s":0.954761,"redis_calls":13,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00879,"completed_at":"2026-09-14T08:38:25.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2378gitlab # [ 252.477661] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac6835fe2d2d2e95a2f6920c","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac6835fe2d2d2e95a2f6920c: start","job_status":"start","queue_duration_s":0.96438,"scheduling_latency_s":0.964394}2379gitlab # [ 252.478406] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac6835fe2d2d2e95a2f6920c","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac6835fe2d2d2e95a2f6920c: done: 0.008736 sec","job_status":"done","queue_duration_s":0.96438,"scheduling_latency_s":0.964394,"redis_calls":13,"redis_duration_s":0.001392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008736,"completed_at":"2026-09-14T08:38:25.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2380gitlab # [ 252.517596] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c96a2f40231d4a8afa8c7989","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c96a2f40231d4a8afa8c7989: start","job_status":"start","queue_duration_s":0.973956,"scheduling_latency_s":0.97397}2381gitlab # [ 252.518523] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c96a2f40231d4a8afa8c7989","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c96a2f40231d4a8afa8c7989: done: 0.008877 sec","job_status":"done","queue_duration_s":0.973956,"scheduling_latency_s":0.97397,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008877,"completed_at":"2026-09-14T08:38:25.120Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 252.534571] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a97c12efd14fce197b781bd","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a97c12efd14fce197b781bd: start","job_status":"start","queue_duration_s":0.98366,"scheduling_latency_s":0.983674}2383gitlab # [ 252.546150] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a97c12efd14fce197b781bd","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a97c12efd14fce197b781bd: done: 0.009607 sec","job_status":"done","queue_duration_s":0.98366,"scheduling_latency_s":0.983674,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009607,"completed_at":"2026-09-14T08:38:25.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 252.587155] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3598b09c2ad1da06e6e49b06","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3598b09c2ad1da06e6e49b06: start","job_status":"start","queue_duration_s":0.994113,"scheduling_latency_s":0.994126}2385gitlab # [ 252.630867] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3598b09c2ad1da06e6e49b06","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3598b09c2ad1da06e6e49b06: done: 0.008923 sec","job_status":"done","queue_duration_s":0.994113,"scheduling_latency_s":0.994126,"redis_calls":13,"redis_duration_s":0.0013809999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008923,"completed_at":"2026-09-14T08:38:25.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 252.631979] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ed7ead29a3f2cd5b71cc5cf","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ed7ead29a3f2cd5b71cc5cf: start","job_status":"start","queue_duration_s":1.003889,"scheduling_latency_s":1.003903}2387gitlab # [ 252.639144] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ed7ead29a3f2cd5b71cc5cf","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ed7ead29a3f2cd5b71cc5cf: done: 0.009011 sec","job_status":"done","queue_duration_s":1.003889,"scheduling_latency_s":1.003903,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000451,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009011,"completed_at":"2026-09-14T08:38:25.150Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2388gitlab # [ 252.694997] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f04d182436247bdae2f72f6","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f04d182436247bdae2f72f6: start","job_status":"start","queue_duration_s":1.013694,"scheduling_latency_s":1.013707}2389gitlab # [ 252.695760] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f04d182436247bdae2f72f6","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f04d182436247bdae2f72f6: done: 0.009115 sec","job_status":"done","queue_duration_s":1.013694,"scheduling_latency_s":1.013707,"redis_calls":13,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009115,"completed_at":"2026-09-14T08:38:25.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 252.747905] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03806090f472c61fa1bfe06f","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03806090f472c61fa1bfe06f: start","job_status":"start","queue_duration_s":1.023671,"scheduling_latency_s":1.023686}2391gitlab # [ 252.748739] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03806090f472c61fa1bfe06f","created_at":"2026-09-14T08:38:24.089Z","trace_propagation_headers":{"sentry-trace":"d826931d8c6d4130b291325dadc6ef15-5a005921a48c4001","baggage":"sentry-trace_id=d826931d8c6d4130b291325dadc6ef15,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9f2455339e63a6bdc3de92a4b662fa8d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.137Z","job_size_bytes":2,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03806090f472c61fa1bfe06f: done: 0.008922 sec","job_status":"done","queue_duration_s":1.023671,"scheduling_latency_s":1.023686,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008922,"completed_at":"2026-09-14T08:38:25.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2392gitlab # [ 252.797697] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.171Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f61cfe4021744354e1df63c9","created_at":"2026-09-14T08:38:24.217Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.220Z","job_size_bytes":23,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f61cfe4021744354e1df63c9: start","job_status":"start","queue_duration_s":0.950253,"scheduling_latency_s":0.950265}2393gitlab # [ 252.798523] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.199Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f61cfe4021744354e1df63c9","created_at":"2026-09-14T08:38:24.217Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.220Z","job_size_bytes":23,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f61cfe4021744354e1df63c9: done: 0.028137 sec","job_status":"done","queue_duration_s":0.950253,"scheduling_latency_s":0.950265,"redis_calls":7,"redis_duration_s":0.0030729999999999998,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00275,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028137,"completed_at":"2026-09-14T08:38:25.199Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005365,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2394gitlab # [ 252.855761] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.200Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ea91cc619a94f2a80bc1c4ce","created_at":"2026-09-14T08:38:24.591Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.593Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ea91cc619a94f2a80bc1c4ce: start","job_status":"start","queue_duration_s":0.606265,"scheduling_latency_s":0.606281}2395gitlab # [ 252.856073] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.215Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ea91cc619a94f2a80bc1c4ce","created_at":"2026-09-14T08:38:24.591Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.593Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ea91cc619a94f2a80bc1c4ce: done: 0.01546 sec","job_status":"done","queue_duration_s":0.606265,"scheduling_latency_s":0.606281,"redis_calls":7,"redis_duration_s":0.000915,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01546,"completed_at":"2026-09-14T08:38:25.215Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2396gitlab # [ 252.902731] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.216Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0718e4d88fea54fc7687b443","created_at":"2026-09-14T08:38:24.598Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.599Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0718e4d88fea54fc7687b443: start","job_status":"start","queue_duration_s":0.617014,"scheduling_latency_s":0.617028}2397gitlab # [ 252.903733] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.232Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0718e4d88fea54fc7687b443","created_at":"2026-09-14T08:38:24.598Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.599Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0718e4d88fea54fc7687b443: done: 0.01595 sec","job_status":"done","queue_duration_s":0.617014,"scheduling_latency_s":0.617028,"redis_calls":7,"redis_duration_s":0.000876,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01595,"completed_at":"2026-09-14T08:38:25.232Z","load_balancing_strategy":"primary","db_duration_s":0.002456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2398gitlab # [ 252.951776] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.233Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"31f393701ecf64a98b11e216","created_at":"2026-09-14T08:38:24.605Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.606Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-31f393701ecf64a98b11e216: start","job_status":"start","queue_duration_s":0.626782,"scheduling_latency_s":0.626796}2399gitlab # [ 252.952572] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.250Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"31f393701ecf64a98b11e216","created_at":"2026-09-14T08:38:24.605Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.606Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-31f393701ecf64a98b11e216: done: 0.01752 sec","job_status":"done","queue_duration_s":0.626782,"scheduling_latency_s":0.626796,"redis_calls":10,"redis_duration_s":0.001281,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000373,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01752,"completed_at":"2026-09-14T08:38:25.250Z","load_balancing_strategy":"primary","db_duration_s":0.002547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2400gitlab # [ 253.011865] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.251Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"35e8d0d395ffdcdf7dadf6df","created_at":"2026-09-14T08:38:24.606Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.608Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-35e8d0d395ffdcdf7dadf6df: start","job_status":"start","queue_duration_s":0.643618,"scheduling_latency_s":0.643632}2401gitlab # [ 253.012691] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.291Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"35e8d0d395ffdcdf7dadf6df","created_at":"2026-09-14T08:38:24.606Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.608Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-35e8d0d395ffdcdf7dadf6df: done: 0.039597 sec","job_status":"done","queue_duration_s":0.643618,"scheduling_latency_s":0.643632,"redis_calls":7,"redis_duration_s":0.0009490000000000001,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039597,"completed_at":"2026-09-14T08:38:25.291Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2402gitlab # [ 253.060448] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.292Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"13a45cc91125f2c46eff0136","created_at":"2026-09-14T08:38:24.608Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.610Z","job_size_bytes":19,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-13a45cc91125f2c46eff0136: start","job_status":"start","queue_duration_s":0.682129,"scheduling_latency_s":0.682145}2403gitlab # [ 253.061088] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.306Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"13a45cc91125f2c46eff0136","created_at":"2026-09-14T08:38:24.608Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.610Z","job_size_bytes":19,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-13a45cc91125f2c46eff0136: done: 0.014142 sec","job_status":"done","queue_duration_s":0.682129,"scheduling_latency_s":0.682145,"redis_calls":8,"redis_duration_s":0.000993,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000222,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014142,"completed_at":"2026-09-14T08:38:25.306Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2404gitlab # [ 253.102826] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.307Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3f662d914322817279ec2804","created_at":"2026-09-14T08:38:24.610Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.625Z","job_size_bytes":66,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3f662d914322817279ec2804: start","job_status":"start","queue_duration_s":0.682128,"scheduling_latency_s":0.682141}2405gitlab # [ 253.103709] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.319Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3f662d914322817279ec2804","created_at":"2026-09-14T08:38:24.610Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.625Z","job_size_bytes":66,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3f662d914322817279ec2804: done: 0.012703 sec","job_status":"done","queue_duration_s":0.682128,"scheduling_latency_s":0.682141,"redis_calls":7,"redis_duration_s":0.000834,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012703,"completed_at":"2026-09-14T08:38:25.319Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2406gitlab # [ 253.146053] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.320Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b5e934e428c1976cfd8b4783","created_at":"2026-09-14T08:38:24.626Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.627Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b5e934e428c1976cfd8b4783: start","job_status":"start","queue_duration_s":0.693067,"scheduling_latency_s":0.693079}2407gitlab # [ 253.152119] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.340Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b5e934e428c1976cfd8b4783","created_at":"2026-09-14T08:38:24.626Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.627Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b5e934e428c1976cfd8b4783: done: 0.019168 sec","job_status":"done","queue_duration_s":0.693067,"scheduling_latency_s":0.693079,"redis_calls":7,"redis_duration_s":0.000958,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019168,"completed_at":"2026-09-14T08:38:25.340Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2408gitlab # [ 253.193930] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.340Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"48fff5ea20f75ec6531470d0","created_at":"2026-09-14T08:38:24.631Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.632Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-48fff5ea20f75ec6531470d0: start","job_status":"start","queue_duration_s":0.708725,"scheduling_latency_s":0.708738}2409gitlab # [ 253.234773] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.356Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"48fff5ea20f75ec6531470d0","created_at":"2026-09-14T08:38:24.631Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.632Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-48fff5ea20f75ec6531470d0: done: 0.015468 sec","job_status":"done","queue_duration_s":0.708725,"scheduling_latency_s":0.708738,"redis_calls":7,"redis_duration_s":0.00112,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015468,"completed_at":"2026-09-14T08:38:25.356Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2410gitlab # [ 253.240620] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.359Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"acc4af7c0210ded7b4945303","created_at":"2026-09-14T08:38:24.632Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.633Z","job_size_bytes":6,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-acc4af7c0210ded7b4945303: start","job_status":"start","queue_duration_s":0.725616,"scheduling_latency_s":0.72563}2411gitlab # [ 253.254776] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.372Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"acc4af7c0210ded7b4945303","created_at":"2026-09-14T08:38:24.632Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.633Z","job_size_bytes":6,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-acc4af7c0210ded7b4945303: done: 0.01309 sec","job_status":"done","queue_duration_s":0.725616,"scheduling_latency_s":0.72563,"redis_calls":7,"redis_duration_s":0.002647,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01309,"completed_at":"2026-09-14T08:38:25.372Z","load_balancing_strategy":"primary","db_duration_s":0.000474,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2412gitlab # [ 253.300850] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.373Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"402609c0975486866dd5b9df","created_at":"2026-09-14T08:38:24.633Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.634Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-402609c0975486866dd5b9df: start","job_status":"start","queue_duration_s":0.738396,"scheduling_latency_s":0.738416}2413gitlab # [ 253.341775] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.388Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"402609c0975486866dd5b9df","created_at":"2026-09-14T08:38:24.633Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.634Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-402609c0975486866dd5b9df: done: 0.014995 sec","job_status":"done","queue_duration_s":0.738396,"scheduling_latency_s":0.738416,"redis_calls":7,"redis_duration_s":0.000869,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014995,"completed_at":"2026-09-14T08:38:25.388Z","load_balancing_strategy":"primary","db_duration_s":0.001863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2414gitlab # [ 253.342871] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.389Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"980e63338b85a1cb04d31096","created_at":"2026-09-14T08:38:24.666Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.667Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-980e63338b85a1cb04d31096: start","job_status":"start","queue_duration_s":0.72141,"scheduling_latency_s":0.721422}2415gitlab # [ 253.383298] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.715Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"980e63338b85a1cb04d31096","created_at":"2026-09-14T08:38:24.666Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-4acc98c26b1d423e","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:24.667Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-980e63338b85a1cb04d31096: done: 0.326808 sec","job_status":"done","queue_duration_s":0.72141,"scheduling_latency_s":0.721422,"gitaly_calls":3,"gitaly_duration_s":0.195934,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008449,"redis_read_bytes":144,"redis_write_bytes":16876,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000525,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001002,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":20,"redis_queues_duration_s":0.001873,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11225,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.002678,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000159,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000569,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.034,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.034,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080718,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.306013195,"duration_s":0.326808,"completed_at":"2026-09-14T08:38:25.715Z","load_balancing_strategy":"primary","db_duration_s":0.047223,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2416gitlab # [ 253.434036] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.717Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c9859b0b06e70fad11dc9abf","created_at":"2026-09-14T08:38:25.455Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.456Z","job_size_bytes":23,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c9859b0b06e70fad11dc9abf: start","job_status":"start","queue_duration_s":0.260529,"scheduling_latency_s":0.260545}2417gitlab # [ 253.434711] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.741Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c9859b0b06e70fad11dc9abf","created_at":"2026-09-14T08:38:25.455Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.456Z","job_size_bytes":23,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c9859b0b06e70fad11dc9abf: done: 0.024221 sec","job_status":"done","queue_duration_s":0.260529,"scheduling_latency_s":0.260545,"redis_calls":7,"redis_duration_s":0.000898,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024221,"completed_at":"2026-09-14T08:38:25.741Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004297,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2418gitlab # [ 253.451682] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.742Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f1ab9b198d233c3ee1654257","created_at":"2026-09-14T08:38:25.595Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.596Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f1ab9b198d233c3ee1654257: start","job_status":"start","queue_duration_s":0.14532,"scheduling_latency_s":0.145334}2419gitlab # [ 253.489345] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.757Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f1ab9b198d233c3ee1654257","created_at":"2026-09-14T08:38:25.595Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.596Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f1ab9b198d233c3ee1654257: done: 0.015341 sec","job_status":"done","queue_duration_s":0.14532,"scheduling_latency_s":0.145334,"redis_calls":7,"redis_duration_s":0.0010479999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015341,"completed_at":"2026-09-14T08:38:25.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002254,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2420gitlab # [ 253.529750] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.758Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"102dddd90dfe37cd46638c34","created_at":"2026-09-14T08:38:25.601Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.604Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-102dddd90dfe37cd46638c34: start","job_status":"start","queue_duration_s":0.154395,"scheduling_latency_s":0.154408}2421gitlab # [ 253.530079] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.774Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"102dddd90dfe37cd46638c34","created_at":"2026-09-14T08:38:25.601Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.604Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-102dddd90dfe37cd46638c34: done: 0.015672 sec","job_status":"done","queue_duration_s":0.154395,"scheduling_latency_s":0.154408,"redis_calls":7,"redis_duration_s":0.000866,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015672,"completed_at":"2026-09-14T08:38:25.774Z","load_balancing_strategy":"primary","db_duration_s":0.002576,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2422gitlab # [ 253.576724] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.775Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"6b2b4fd2e668a3745dfed2a8","created_at":"2026-09-14T08:38:25.610Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.611Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6b2b4fd2e668a3745dfed2a8: start","job_status":"start","queue_duration_s":0.163339,"scheduling_latency_s":0.163354}2423gitlab # [ 253.577537] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.792Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"6b2b4fd2e668a3745dfed2a8","created_at":"2026-09-14T08:38:25.610Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.611Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6b2b4fd2e668a3745dfed2a8: done: 0.017415 sec","job_status":"done","queue_duration_s":0.163339,"scheduling_latency_s":0.163354,"redis_calls":10,"redis_duration_s":0.0012980000000000001,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000376,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017415,"completed_at":"2026-09-14T08:38:25.792Z","load_balancing_strategy":"primary","db_duration_s":0.002584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2424gitlab # [ 253.618613] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.793Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"51536e4ebf5af13271838734","created_at":"2026-09-14T08:38:25.612Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.613Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-51536e4ebf5af13271838734: start","job_status":"start","queue_duration_s":0.180315,"scheduling_latency_s":0.18033}2425gitlab # [ 253.658093] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.808Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"51536e4ebf5af13271838734","created_at":"2026-09-14T08:38:25.612Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.613Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-51536e4ebf5af13271838734: done: 0.014775 sec","job_status":"done","queue_duration_s":0.180315,"scheduling_latency_s":0.18033,"redis_calls":7,"redis_duration_s":0.000958,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014775,"completed_at":"2026-09-14T08:38:25.808Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2426gitlab # [ 253.658975] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.809Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"91d34203bb92658f633b6ac3","created_at":"2026-09-14T08:38:25.613Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.614Z","job_size_bytes":19,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-91d34203bb92658f633b6ac3: start","job_status":"start","queue_duration_s":0.194372,"scheduling_latency_s":0.194385}2427gitlab # [ 253.710633] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.822Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"91d34203bb92658f633b6ac3","created_at":"2026-09-14T08:38:25.613Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.614Z","job_size_bytes":19,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-91d34203bb92658f633b6ac3: done: 0.01353 sec","job_status":"done","queue_duration_s":0.194372,"scheduling_latency_s":0.194385,"redis_calls":8,"redis_duration_s":0.001026,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01353,"completed_at":"2026-09-14T08:38:25.822Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2428gitlab # [ 253.711666] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.823Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7ea08b3017fa8bebb46a113a","created_at":"2026-09-14T08:38:25.615Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.616Z","job_size_bytes":66,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7ea08b3017fa8bebb46a113a: start","job_status":"start","queue_duration_s":0.207206,"scheduling_latency_s":0.207219}2429gitlab # [ 253.752760] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.839Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7ea08b3017fa8bebb46a113a","created_at":"2026-09-14T08:38:25.615Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.616Z","job_size_bytes":66,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7ea08b3017fa8bebb46a113a: done: 0.015974 sec","job_status":"done","queue_duration_s":0.207206,"scheduling_latency_s":0.207219,"redis_calls":7,"redis_duration_s":0.0009440000000000001,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015974,"completed_at":"2026-09-14T08:38:25.839Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2430gitlab # [ 253.793854] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.840Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"553605363ee1189def033ead","created_at":"2026-09-14T08:38:25.616Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.617Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-553605363ee1189def033ead: start","job_status":"start","queue_duration_s":0.223076,"scheduling_latency_s":0.223095}2431gitlab # [ 253.794652] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.857Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"553605363ee1189def033ead","created_at":"2026-09-14T08:38:25.616Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.617Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-553605363ee1189def033ead: done: 0.016599 sec","job_status":"done","queue_duration_s":0.223076,"scheduling_latency_s":0.223095,"redis_calls":7,"redis_duration_s":0.001188,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016599,"completed_at":"2026-09-14T08:38:25.857Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003465,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2432gitlab # [ 253.836924] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.857Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e0fb4cb64c56ceaff1c8b2cc","created_at":"2026-09-14T08:38:25.617Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.618Z","job_size_bytes":6,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e0fb4cb64c56ceaff1c8b2cc: start","job_status":"start","queue_duration_s":0.239376,"scheduling_latency_s":0.239389}2433gitlab # [ 253.837646] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.865Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e0fb4cb64c56ceaff1c8b2cc","created_at":"2026-09-14T08:38:25.617Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.618Z","job_size_bytes":6,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e0fb4cb64c56ceaff1c8b2cc: done: 0.008076 sec","job_status":"done","queue_duration_s":0.239376,"scheduling_latency_s":0.239389,"redis_calls":7,"redis_duration_s":0.0009040000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000224,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008076,"completed_at":"2026-09-14T08:38:25.865Z","load_balancing_strategy":"primary","db_duration_s":0.00023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2434gitlab # [ 253.887703] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.866Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"14f6afd70ba0a45b2d636bef","created_at":"2026-09-14T08:38:25.618Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.619Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-14f6afd70ba0a45b2d636bef: start","job_status":"start","queue_duration_s":0.247162,"scheduling_latency_s":0.247175}2435gitlab # [ 253.888485] sidekiq-cluster[2503]: {"severity":"INFO","time":"2026-09-14T08:38:25.879Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"14f6afd70ba0a45b2d636bef","created_at":"2026-09-14T08:38:25.618Z","trace_propagation_headers":{"sentry-trace":"6b3951f692154aa08b2603c697d48302-a7ee5fa2208442ea","baggage":"sentry-trace_id=6b3951f692154aa08b2603c697d48302,sentry-release=Unknown"},"correlation_id":"01M2FH2GADJ7999Z571WMJNCMF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-14T08:38:25.619Z","job_size_bytes":3,"pid":2503,"sidekiq_tid":"m7wz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-14f6afd70ba0a45b2d636bef: done: 0.012857 sec","job_status":"done","queue_duration_s":0.247162,"scheduling_latency_s":0.247175,"redis_calls":7,"redis_duration_s":0.000851,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012857,"completed_at":"2026-09-14T08:38:25.879Z","load_balancing_strategy":"primary","db_duration_s":0.001867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2436gitlab # [ 254.012514] gitaly[911]: time="2026-09-14T08:38:28.321Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2N5BCN0QDDPM2A26NZFN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T08:38:58.220" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T08:38:28.321" grpc.time_ms=0.477 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2437gitlab # [ 254.036230] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 762438gitlab # [ 254.040216] gitaly[911]: time="2026-09-14T08:38:28.350Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2N5C56EY9ST96VKZTK17 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:28.342" pid=911 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2439gitlab # [ 254.048816] gitaly[911]: time="2026-09-14T08:38:28.350Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2N5C56EY9ST96VKZTK17 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:28.342" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2440gitlab # [ 254.059992] gitlab-workhorse[829]: time="2026-09-14T08:38:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672441gitlab # [ 254.061695] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 822442gitlab # [ 254.064273] gitaly[911]: time="2026-09-14T08:38:28.350Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FH2N5C56EY9ST96VKZTK17 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:28.342" grpc.time_ms=8.111 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2443gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/c3ed311f746d9e796bcb062f5c7ef32fcecb83ea/statuses, in 3.07 seconds)2444(finished: subtest: eval and build post commit statuses, in 9.94 seconds)2445(finished: run the VM test script, in 301.05 seconds)2446gitlab # [ 254.110459] gitaly[911]: time="2026-09-14T08:38:28.420Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FH2N8XVR0AD1HRY3QGB9SS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T08:38:28.414" grpc.time_ms=6.028 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2447gitlab # [ 254.123541] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/14:08:38:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 512448test script finished in 301.09s2449cleanup2450kill QemuMachine (pid 46)2451gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2452(finished: cleanup, in 1.25 seconds)2453additionally exposed symbols:2454 gitlab,2455 vlan1,2456 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2457[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-14T08:37:30.203Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2458[]2459[]2460[]2461[]2462[]2463[]2464[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-14T08:38:17.565895Z', 'started_at': '2026-09-14T08:38:17.785202Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2465[{'id': 5, 'sha': 'c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-14T08:38:17.764Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2466[{'id': 5, 'sha': 'c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-14T08:38:17.764Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2467[{'id': 5, 'sha': 'c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-14T08:38:17.764Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2468[{'id': 5, 'sha': 'c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-14T08:38:17.764Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2469[{'id': 5, 'sha': 'c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-14T08:38:17.764Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2470[{'id': 5, 'sha': 'c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-09-14T08:38:17.764Z', 'started_at': None, 'finished_at': '2026-09-14T08:38:23.409Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-09-14T08:38:24.270Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2471[{'id': 5, 'sha': 'c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-09-14T08:38:17.764Z', 'started_at': None, 'finished_at': '2026-09-14T08:38:23.409Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'c3ed311f746d9e796bcb062f5c7ef32fcecb83ea', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-14T08:38:24.270Z', 'started_at': None, 'finished_at': '2026-09-14T08:38:24.383Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]